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ABSTRACT 

Characteristics of seismic activity from 1970 to 2010 along the North Anatolian Fault Zone (NAFZ) are 
analyzed to make a statistical assessment by using the Gutenberg-Richter fo-value, seismic quiescence Z-value, 
fractal dimension Dc-value, and spatial, temporal and magnitude distributions. Magnitude completeness, Mc, 
changes between 2.7 and 2.9 in all parts of the NAFZ. Frequency-magnitude distribution of the earthquakes is 
well represented by the Gutenberg-Richter law with a fo-value typically close to 1 . A strong decrease in temporal 
distribution of £>-value is observed before the great main shocks. Dc-values are relatively large and the seismic 
activity is more clustered at larger scales for all parts of the NAFZ. From the standard normal deviate Z-value 
test, eight significant anomalous zones are centered at 41.08°N-28.58°E (around Silivri), 41.47°N-29.51°E (in the 
Black Sea), 40.69°N-29.78°E (including Izmit), 40.26°N-26.46°E (around Gelibolu, Canakkale), 40.59°N- 
31.03°E (including Duzce fault), 40.86°N-35.30°E (around Amasya), 39.48°N-39.74°E (around Erzincan), and 
39.06°N-40.50°E (around Bingol). 

Keywords: Seismicity, North Anatolian Fault Zone, b-value, Dc-value, Z-value. 



1. INTRODUCTION 

The variation of the seismic patterns in space and time in the North Anatolian Fault Zone (NAFZ), Turkey, is 
analyzed statistically and physically by many authors and some significant results are obtained [e.g., 1,2,3,4,5]. 
The NAFZ is one of the most seismically active regions of Turkey. The NAFZ is a major tectonic feature with a 
well-defined fault trace and an established history of seismicity. Because of topography and water resources, the 
fault zone is a relatively densely populated, agricultural area dotted by many villages and small towns. Most 
intermediate and large magnitude earthquakes occurring along the North Anatolian Fault (NAF) have produced 
surface breaks. Activity of the NAF during the 20 r century began with the destructive Erzincan earthquake in 
1939 in northeast Turkey and it migrated westwards by a series of earthquakes in 1942, 1943, 1944, 1951, 1957 
and 1967 [6,7]. 

At the turn of the previous century, two destructive earthquakes occurred on the western continuation of the 
NAFZ in northwestern Turkey. The 17 August 1999, M w 7.4, Izmit earthquake ruptured the NAFZ along a 125- 
km segment, which extended from Golyaka, Duzce, in the east through the Izmit Bay into the Sea of Marmara in 
the west. The 12 November 1999, M w 7.2, Duzce earthquake ruptured a segment about 50 km long, further to the 
east [8]. These two earthquakes are the latest in a sequence of large events that have ruptured an approximately 
1000-km-long section of the NAFZ. This sequence began with the 1939 Erzincan earthquake in the northeastern 
part of Turkey, followed by a generally westward migration of earthquakes [6,7]. 

This work aims to identify the seismicity behaviors in the North Anatolian Fault Zone in order to better 
understand the earthquake properties in this significant area. For this purpose, this study is addressed the 
mapping of size-scaling distributions such as spatial, temporal and magnitude distribution of seismic activity, 
completeness magnitude Mc and ^-values with time, seismic quiescence Z-value, fractal dimension Dc and the 
correlation of results with the structural elements which carry high risk for the region. 
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2. DATA AND ACTIVE TECTONICS OF THE NORTH ANATOLIAN FAULT ZONE 

A part of the database used in this study is taken from Oztiirk [9]. Oztiirk [9] developed some relationships 
between different magnitude scales (m 6 -body wave magnitude, Mj-surface wave magnitude, M L -local magnitude, 
M D -duration magnitude) in order to prepare a homogenous earthquake catalogue from different data sets. For this 
purpose, he used the catalogue data from the website of the International Seismological Centre (ISC) for the time 
period from 1970 to 1973 and Bogazici University, Kandilli Observatory and Research Institute (KOERI) for the 
time interval 1974 and 2005. He prepared a homogenous instrumental data catalogue for M D magnitude using 
these relationships. This homogeneous catalogue for duration magnitude includes 73530 earthquakes whose 
magnitudes are equal to or larger than 1.4, which occurred in Turkey between 1970 and 2006. Oztiirk [9] used 
the empirical relations in order to get a homogenous catalogue from 1970 to 2006 and so this relatively smaller 
magnitude level M D >\A is obtained. For the time period between 2006 and 2010, KOERI catalogue is also used. 
The bounds of the region analyzed in this study are provided from Oztiirk [9]. Since Oztiirk [9] made a detailed 
zonation, a part of these seismic source zones is considered in this study. The North Anatolian Fault Zone is 
selected as an area of investigation in this study. According to Oztiirk [9], region 20 (region 1 in this study) 
covers the Marmara part of the North Anatolian Fault Zone (MNAFZ), region 21 (region 2 in this study) is the 
Anatolian part of the North Anatolian Fault Zone (ANAFZ) and region 24 (region 3 in this study) is the Eastern 
part of the North Anatolian Fault Zone (ENAFZ). The major tectonic structures of the region adopted from 
Saroglu et al. [10] and the zones from Oztiirk [9] are shown in Figure 1. 

There are total 2804 events in these three regions between 2006 and 2010. The time interval considered for the 
present work is 1970 to 2010. The magnitudes in the used catalogue are M fl -duration magnitude. Thus, the final 
data catalogue for region 1 (9884 events), region 2 (4669 events) and region 3 (2645 events) consists of 17198 
earthquakes in total (depth<70 km) with magnitudes greater than or equal to 1 .4. Epicenter distributions of whole 
earthquakes (M D >1.4) and the principal main shocks (M D >5.5) in the study region are shown in Figure 2. 
The North Anatolian Fault Zone is one of the best-known strike-slip faults in the world because of its remarkable 
seismic activity, extremely well developed surface expression and importance for the tectonics of eastern 
Mediterranean region [11]. The NAFZ is a very active structure, and according to geodesy it accommodates 24- 
30 mm/yr of dextral motion [12]. The NAFZ is an approximately 1500 km-long, broadly arc-shaped, dextral 
strike-slip fault system that extends from eastern Turkey in the east to the north Aegean in the west. It is 
predominantly a single zone of a few hundred meters to 40 km wide. Along much of its length, this fault zone 
consists of a few shorter sub-parallel fault strands that sometimes display an anatomizing pattern [11]. To the 
east, the NAFZ forms a typical triple-junction and joins with the sinistral East Anatolian Fault Zone at Karhova. 
The NAFZ does not terminate at the Karhova triple junction but, continues towards south east. During the past 
60 years, NAFZ has produced earthquakes along different sections in a system manner that is atypical of long 
faults. Beginning with 1939 Erzincan earthquake (M=7.9 to 8.0), which produced about 350 km of ground 
rupture, the NAFZ ruptured by nine moderate to large earthquakes (M>6.7), and formed more than 1000 km 
surface rupture along the fault. Most of the earthquakes occurred sequentially in a westward progression. These 
include 26 December 1939 Erzincan (M=7.9 to 8.0), 20 December 1942 Erbaa-Niksar (M=7.1), 26 November 
1943 Tosya (M=7.6), 1 February 1944 Bolu-Gerede (M=7.3), 13 August 1951 Cankin (M=6.9) 26 May 1957 
Abant (M=7.0), 22 July 1967 Mudurnu valley (M=7.1), 13 March 1992 Erzincan (M=6.8), 17 August 1999 Izmit 
(M=7.4), and 12 November 1999 Duzce (M=7.2) earthquakes [11]. 
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Figure 1 . Tectonic structures and seismic source zones in the North Anatolian Fault Zone. Faults were modified 
from Saroglu et al. [10] and the seismic regions from Oztiirk [9]. (1: Marmara part of the North Anatolian Fault 
Zone, 2: Anatolian part of the North Anatolian Fault Zone, 3: Eastern part of the North Anatolian Fault Zone). 
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Figure 2. Seismicity in the North Anatolian Fault Zone including all earthquakes with M D >\A and depth<70 km 
between February 1970 and December 2009. Stars represent the principal main shocks with M D >5.5. 

3. DEFINITION OF THE THEORETICAL BACKGROUND 



A number of seismicity parameters are used in order to characterize the seismic behavior along the North 
Anatolian Fault Zone. These parameters are size-scaling parameters (such as slope of recurrence curve £>-value), 
temporal and spatial distribution of earthquakes with characteristic of fractal correlation dimension, Dc, and 
seismic quiescence Z- value as well as the histograms of temporal, spatial and magnitude distribution. 

3.1. Magnitude-frequency relation (fe-value) and completeness magnitude (Mc value) 

Size distribution of earthquakes in most cases is well described by the Gutenberg and Richter [13] relationship: 



log l0 N(M) = a-bM 



(1) 



where N(M) is the cumulative number of earthquakes with magnitudes equal to or larger than M, b describes the 
slope of the size distribution of events, and a is proportional to the seismicity rate. £>-value is one of the most 
widely used statistical parameters to describe the size scaling properties of seismicity. Utsu [14] summarized that 
Z?-values change roughly in the range 0.5 to 1.5, depending on the different region. However, on average, the 
regional scale estimates of £>-value are approximately equal to 1 [15]. The maximum likelihood method provides 
the least biased estimate of Z?-value [16]: 



* = 2.303/(M„ -M^+0.05) 



(2) 



where M mecm is the mean magnitude of events and M mi „ is the minimum magnitude of completeness in the 
earthquake catalogue. Accurate estimates of local changes of M„„„ can be made if relatively large numbers (100 
or so) of local observations are available for analysis [17]. The value 0.05 in Eq. (2) is a correction constant that 
compensates for round off errors. The 95% confidence limits on the estimates of fr-value are ± 1 .96£> / -Jn , where 
n is the number of earthquakes used to make the estimate. This yields confidence limits on Z?-value of +0.1-0.2 
for a typical sample consisting of n=100 earthquakes. 

The magnitude above which all events have been recorded is important for all seismicity-based studies because it 
is frequently necessary to use the maximum number of events available for high-quality results. The estimate of 
the magnitude of completeness (Mc) is based on the assumption of Gutenberg Richter' s power-law distribution 
against magnitude [17]. Completeness in magnitude reporting varies systematically as a function of space and 
time, and particularly the temporal changes can potentially produce erroneous estimates of seismicity 
parameters, especially in £>-value. Since a part of this study deals with the seismicity rate change, the magnitude 
of completeness of the catalog used to detect the quiescence is an important parameter. 

3.2. Fractal Dimension, Dc 

Fractal distributions imply that the number of objects larger than a specified size has a power law dependence on 
the size. Spatial patterns of earthquake distribution and temporal patterns of occurrence are demonstrated to be 
fractal using the two-point correlation dimension Dc. The correlation integral method was developed by 
Grassberger and Procaccia [18] and correlation dimension Dc is obtained from following equations: 
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Dc = lim[logC(r)/ log r], (3) 

r-»0 

C(r) = 2N R<r /N(N-l), (4) 

where C{r) is the correlation function, r is the distance between two epicenters or hypocenters and N is the 
number of events pairs separated by a distance R<r. Fractal dimension is defined by fitting a straight line to a 
plot of log C{r) against log r. The nature of temporal-spatial fractal properties of the earthquake epicenters is 
characterized by fractal, in particular by the correlation dimension [19]. For the hypocenter distribution (3-D 
space), the uniform distribution equals the Eq. 4 and it decreases with an increase in the clustering of events [20]. 
It is reasonable to assume that the higher Dc and lower ^-values are the dominant structural feature in the study 
area and may arise due to clusters. 

3.3. Seismic quiescence Z-value and declustering of the catalogues 

For the quantitative analysis of seismicity rate changes, it is necessary to eliminate the dependent events from the 
catalog. To separate the dependent events from the independent ones the earthquake catalog is declustered using 
the Reasenberg [21] algorithm. The cluster analysis algorithm of Reasenberg [21] "declusters" or decomposes a 
regional earthquake catalogue into main and secondary events. It removes all the dependent events from each 
cluster, and substitutes them with a unique event, equivalent in energy to that of the whole cluster. ZMAP 
software in Wiemer [22] is used for the declustering method. It is only changed epicenter and depth error values. 
Other standard parameters are defined as given in the software. 

There are 9884 events in region 1 with magnitudes greater than or equal to 1.4. Mc value is 2.7 for region 1 and 
the number of earthquakes exceeding this magnitude threshold is 6514. The declustering procedure took away 
258 (about 4%) events and 37% of the events in total were removed from whole catalogue of region 1. Thus, the 
number of events for Z-value analysis was reduced to 6256 for the Marmara part of the North Anatolian Fault 
Zone. There are 4669 events in region 2 with magnitudes greater than or equal to 1 .4. Mc value for this region is 
2.9 and the number of earthquakes exceeding this magnitude threshold is 3224. The declustering algorithm took 
away 267 (about 8%) events and 37% of the events were totally removed from whole catalogue of region 2. As a 
result, the number of events for Z-value analysis was reduced to 2957 for the Anatolian part of the North 
Anatolian Fault Zone. In region 3, there are 2645 earthquakes with magnitudes greater than or equal to 2.0. The 
Mc value for region 3 is 2.9 and the number of earthquakes exceeding this magnitude threshold is 1980. The 
declustering process took away 417 (about 21%) events and thus 41% of the events were totally removed from 
whole catalogue of region 3. Consequently, the number of events for Z-value analysis was reduced to 1563 for 
the Eastern part of the North Anatolian Fault Zone and after completing the declustering processes, a more 
reliable, homogeneous and robust seismicity data has been obtained. 

The standard normal deviate Z-test is one of the statistical methods frequently used for analyzing seismic 
quiescence. A continuous image of space and time rate changes in seismicity is produced by ZMAP, creating a 
grid of geographical co-ordinates, and associating to each grid node a selected number of nearest events. It is 
applied the ZMAP method for imaging the areas exhibiting a seismic quiescence. In order to rank the 
significance of quiescence, it is used the standard deviate Z-test [23,24], generating the LTA (Log Term 
Average) function for the statistical evaluation of the confidence level in units of standard deviations: 

Z = (R l -R 2 )/(S 2 /N l +S 2 /N 2 ) l/2 (5) 

where R 2 is the mean seismicity rate in the foreground window, Rj is the average number of events in the whole 
background period, S and N are the standard deviations and the number of samples, within and outside the 
window. The Z-value computed as a function of time, letting the foreground window slide along the time 
duration of catalogue, is called LTA. 

4. SEISMICITY PROPERTIES OF THE NORTH ANATOLIAN FAULT ZONE 

Many statistical analysis techniques of ZMAP software package have been used for the 3 data set of seismicity 
catalogues of the NAFZ. The fe-value in Gutenberg-Richter relationship is calculated by the maximum likelihood 
method, because it yields a more robust estimate than the least-square regression method [25]. Figure 3 shows 
the Gutenberg-Richter relations for all parts of the NAFZ. The ^-values are calculated as 1.13+0.01 with Mc=2.1 
for region 1 (Figure 3a), 1.02+0.02 with Mc=2.9 for region 2 (Figure 3b), and 1.01+0.02 with Mc=2.9 for region 
3 (Figure 3c). It is clearly seen that magnitude-frequency distributions of the earthquakes are well represented by 
the Gutenberg-Richter law with the £>-value typically close to 1 . 
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Figure 3. The £>-value of the frequency-magnitude relationships for (a) region 1, (b) region 2 and (c) region 3. 
The Z?-value and its standard deviation, as well as the a-value in the Gutenberg-Richter relation are given. 

Correlation dimension Dc is estimated by fitting a straight (solid) line to the curve of mean correlation integral 
against the event distance, R (km). .De-values for all parts of the study area are obtained with 95% confidence 
limits by linear regression (Figure 4). The earthquake distribution of 9884 earthquakes in the MNAFZ is shown 
in Figure 4a. Dc is calculated as 2.20+0.03 and this log-log correlation function exhibits a clear linear range and 
scale invariance in the cumulative statistics between 0.50 and 32.15 km (indicated in Figure 4a). The earthquake 
distribution of 4669 events in the ANAFZ is shown in Figure 4b. Dc is computed as 2.40+0.03 and this log-log 
correlation function exhibits a clear linear range and scale invariance in the cumulative statistics between 0.63 
and 24.26 km (indicated in Figure 4b). The earthquake distribution of 2645 earthquakes in the ENAFZ is shown 
in Figure 4c. Dc is calculated as 2.37+0.04 and this log-log correlation function exhibits a clear linear range and 
scale invariance in the cumulative statistics between 1.19 and 1 1.32 km (indicated in Figure 4c). Dc and standard 
error in Figure 4 are also determined within these distances. 
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Figure 4. Fractal dimension for (a) region 1, (b) region 2 and (c) region 3. The slope of the black line 
corresponds to the Dc value and the gray lines illustrate the standard errors. 
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The variation of the fo-value as a function of time in different parts of the NAFZ is also analyzed (Figure 5). 
Temporal changes of fo-value are calculated for sample size of 1000 earthquakes for region 1, 250 earthquakes 
for regions 2 and 3. A systematic increase in £>-value can be observed until 1996 with b>l.5 in region 1. /?-value 
shows a great decrease with b~0.9 before the occurrence of 1999 Izmit earthquake and a clear increase after the 
main shock (Figure 5a). Such kind of behaviors is also observed for some great earthquakes in regions 2 and 3. 
In region 2, there is a clear tendency of decrease with b~0.7 before the 1999 Duzce earthquake and an increase 
with b>l.O after the main shock (Figure 5b). In region 3, the same properties of ^-values showing a decrease are 
observed before the three great earthquakes, ^-values shows a decrease before the occurrence of 2003 Tunceli, 
2003 Bingol and 2005 Bingol earthquake sequences and a clear increase after the main shocks (Figure 5c). The 
Z?-value for a region does not reflect only the relative proportion of the number of large and small earthquakes in 
the region, but is also related to the stress condition over the region [14]. Therefore, it is interpreted that the 
anomalies of decreases in £>-value before the main shocks may be due to an increase in effective stress and can 
be used as an indicator of the future earthquake by observing the changes in fe-value with time in all parts of the 
NAFZ. Also, the step increase in £>-value is related to the reduced stress in these times after the main shocks. 




999, Izmit; earthquake 




1990 1995 

Time (years) 



1995 2000 

Time (years) 
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Figure 5. The fe-value as a function of time for (a) region 1, (b) region 2 and (c) region 3. Standard deviation (8b) 
(dashed lines) is also given. Arrows show the great decrease in ^-values before the large earthquakes. 

Regional distribution of the standard deviate Z- value for all parts of the NAFZ is presented for the beginning of 
2010 (Figure 6). To establish the regional distribution of the seismic quiescence, it is applied the Reasenberg 
[21] algorithm to decluster data. The areas under analysis were divided into rectangular cells spacing 0.02° in 
longitude and latitude. The nearest earthquakes, N, at each node are taken as 50 events for all regions and the 
seismicity rate changes are searched by a moving time window T w =5.5 years. For each grid point we binned the 
earthquake population into many binning spans of 28 days for all regions in order to have a continuous and dense 
coverage in time. Eight significant quiescence anomalies were identified in the study regions. In region 1 
covering the MNAFZ, the first significant anomaly is found centered at 41.08°N-28.58°E (region A, around 
Silivri) and the second one is found centered at 41.47°N-29.51°E (region B, in the Black Sea). The third 
significant quiescence is observed centered at 40.69°N-29.78°E (region C, including Izmit) and the fourth 
significant anomaly is found centered at 40.26°N-26.46°E (region D, around Gelibolu, Canakkale). In region 2 
including the ANAFZ, the first significant anomaly is found centered at 40.59°N-31.03°E (region E, including 
Duzce fault) and the second quiescence area is found centered at 40.86°N-35.30°E (region F, around Amasya). In 
region 3 covering the ENAFZ, the first significant anomaly is found centered at 39.48°N-39.74°E (region G, 
around Erzincan) and the second anomaly is found centered at 39.06°N-40.50°E (region H, around Bingol). 
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Figure 6. Z-value distributions in the beginning of 2010 with T w =5.5 years for (a) region 1, (b) region 2 and (c) 
region 3. White dots show the declustered earthquakes with M D >2.1 for region 1, M D >2.9 for regions 2 and 3. 

5. CONCLUSIONS 

Spatial and temporal properties of the seismic activity from 1970 to 2010 in the North Anatolian Fault Zone are 
investigated in order to characterize the seismic behaviors. For this purpose a number of statistical parameters 
are used; namely size-scaling parameters (such as slope of recurrence curve fr-value), seismic quiescence Z- 
value, temporal and spatial distribution of earthquakes with characteristic of fractal correlation dimension, Dc, as 
well as the histograms of temporal, spatial and magnitude distribution. For this purpose, statistical analysis 
techniques based on the seismic tool ZMAP are applied. The instrumental earthquake catalog of the Bogazici 
University, Kandilli Observatory and Earthquake Research Institute between 1970 and 2010, for 17198 crustal 
earthquakes of magnitude equal and greater than 1.4, with depths less than 70 km is used. The catalogue is 
homogeneous and complete for duration magnitude. 

Magnitude completeness analyses present a value between 2.7 and 2.9 for all parts of the NAFZ. The ^-values 
for all regions are close to 1 and typical for earthquake catalogs. Temporal distributions of ^-values show a 
strong tendency of decreases before the great main shocks and this behavior can be used as an indicator of the 
next earthquake. Correlation dimension values are greater than 2.20 for all parts of the NAFZ. This suggests that 
seismic activity is more clustered at larger scales (or in smaller areas) in the North Anatolian Fault Zone. 
There are eight regions exhibiting significant seismic quiescence on the North Anatolian Fault Zone in the 
beginning of 2010. On the Marmara part of the North Anatolian Fault Zone, four anomalies are found centered at 
41.08°N-28.58°E (around Silivri), 41.47°N-29.51°E (in the Black Sea), 40.69°N-29.78°E (including Izmit) and 
40.26°N-26.46°E (around Gelibolu, Canakkale). The other two quiescence areas are found centered at 40.59°N- 
31.03°E (including Duzce fault) and 40.86°N-35.30°E (around Amasya) on the Anatolian part of the North 
Anatolian Fault Zone. The rest of the quiescence anomalies are found centered at 39.48°N-39.74°E (around 
Erzincan) and 39.06°N-40.50°E (around Bingol) on the Eastern part of the North Anatolian Fault Zone. 
The North Anatolian Fault Zone was struck with devastating earthquakes in recent years. Therefore, prediction 
of the future large earthquake on the NAFZ would be useful. Such a prediction must be relied on the observation 
of phenomena related to precursory quiescence. Previous studies for the North Anatolian Fault zone show that 
the return periods of M D >5.5 have been exceeded in the Anatolian part of the North Anatolian Fault Zone. 
However, the return periods of M >5.5 for the Marmara and the Eastern part and the return period of M D >6.0 for 
the Anatolian part of the North Anatolian Fault Zone will be exceeded between 2010 and 2012. For this reason, 
special attention should be given to these regions where the seismic quiescence is observed. 
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Estimating the Nonlinear Behavior of Mitral 
Valve Doppler Signals 
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In the present study, Nonlinear analysis techniques were realized on mitral valve 
Doppler signals from patient with stenosis and healthy subjects. The maximum 
Lyapunov exponent and correlation dimension variant representing nonlinear 
behavior has been showed the unpredictibility and complexity levels of the 
mitral valve Doppler signals, respectively. As a result our data suggests that 
useful tool to describe complexity of cardiovascular auto regulation. 

1 Introduction 

The ends Mitral valve stenosis is a serious disorder among the heart disease and 
characterized by the narrowing of the orifice of the mitral valve of the heart. 
When the orifice narrows, the blood can only be carried from the left atrium to 
the left ventricle by an abnormally increased from atrial to ventricular pressure 
gradient. Therefore, early diagnosis of mitral valve stenosis has been an 
important aspect for the relevant medical research [ 1 ] . A kind of diagnostic tools 
can be utilized diagnose of mitral valve stenosis. These techniques are 
electrocardiography, chest X-rays, heart sounds murmur from stethoscope, 
Doppler ultrasound imaging and an invasive technique angiography and 
transozefagial echocardiography [2]. Today, color Doppler is the most widely 
used diagnostic tool for assessing intracardiac blood flow, although most cardiac 
valve diseases produce geometrically complex flows [3]. Doppler ultrasound has 
been widely used in noninvasive assessment of cardiovascular disease. In 
ultrasound Doppler systems, an ultrasonic signal is transmitted through the body 
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and an echo signal is backscattered from the red blood cells is received. Under 
these condition, The Doppler shift frequency is given by, 

f% f,-fr= (2/, v cos 0)/C (1) 

In the equation above, f t and f are the transmitted and received ultrasound 

frequencies, respectively, v is the velocity of the blood flow, C is the velocity 
of the sound in the environment and is the angle between ultrasound beam 
and the direction of motion of the target [4]. 

A number of analysis methods are available for the obtaining a pictorial view of 
the Doppler signal of which the best and most commonly used method is spectral 
analysis. Spectral analysis of the Doppler signals produces information about the 
blood flow in the arteries. Traditional spectral analysis techniques have been 
used to extract information about the Doppler signals over the last two decades. 
Doppler signals are nonstationary, although traditional spectral analysis 
techniques are assumed to be the signal as stationary. Therefore, the Doppler 
signals can be considered as a chaotic signals because of complex nonlinear 
characteristics arising from deterministic physical processes [5,6]. The nonlinear 
analysis is a mathematical method applied to describe shapes and numerical 
time-varying processes. 

In our study, chaos analysis was performed on the mitral valve Doppler signals 
to extract information about mitral valve stenosis. 

The aim of this study is to characterize the usefulness of nonlinear analysis in 
mitral valve autoregulation. 

2 Materials and Methodds 
2.1. Patients and Meassurements 

In this study, The Doppler ultrasound signals were acquired from Erciyes 
University Cardiology Hospital, mitral valve of 12 patients with mitral valve 
stenosis with mild level and 13 healthy volunteers. The healthy subjects had no 
clinical and echocardiographic evidence of valvular disease or heart failure. The 
patient group is diagnosed of mitral stenosis through cardiac angiographies. 
Healthy volunteers were young non-smokers who seem to not bear any risk of 
stenosis. 

Doppler echocardiographic examinations were performed with GE Vivid7 
ultrasound device in the cardiology departments of Erciyes university hospital. 
The system hardware was composed of Digital Doppler ultrasound unit that can 
work in the pulsed mode, linear ultrasound probe, input- output card and a 
personal computer. All examinations were recorded on PC and calculations were 
made MATLAB software. 

A linear ultrasound probe of 5 MHz was used to transmit pulsed ultrasound 
signals to the mitral valve. In all recording performed on the patients and healthy 
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subjects, the probe application angle and the presettings of the ultrasound were 
kept constant. The probe application angle was adjusted via electronic steering 
methods. The sampling volume was placed within the center of the mitral valve. 
The amplification gain was carefully set to obtain a clean spectral output with 
minimized background noise on the spectral display. The audio output of 
ultrasound unit was sampled at 44100 Hz [7]. 

The Doppler sonograms belonging to healthy and patient subject is plotted with 
the frequency components and power spectral density values sequenced on the 
timeline as seen figure 1 and 2 respectively. 




Fig. 1. Mitral valve Doppler sonogram derived from healthy subject 




Fig. 2. Mitral valve Doppler sonogram derived from patient subject 

2.2. Nonlinear Analysis of Mitral Valve Doppler Signals 

Nonlinear analysis techniques such as Lyapunov exponents and fractal 
dimension were applied to mitral valve Doppler signals so as to determine 
variability of these signals. 

2.2.1. Phase Space Reconstruction 

Doppler ultrasound signals have time series and nonlinear characteristics. 
Analysis with nonlinear methods for a time series, we need phase space 
reconstruction with time delay samples [8]. Two parameters need to be given: 
the embedding dimension and time delay [9-12]. 
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x i=(.yi>y»T>yi 



+2r' - "' y l+(m-l)T 



■) 



(2) 



In this equation, x is delay time and m is the embedding dimension. Different x 
and m choices reconstructs different trajectories. 



2.2.2. Time Delay 

Taken' s time delay expression theorem is available to obtain the requested 
information from the time series [8]. If x is chosen smaller, data points cannot be 
distinguished from each other. If x is chosen higher, data points are totally 
independent from each other statistically sense. In the nonlinear systems average 
mutual function is used for selecting the x [12]. This function is applied to 
measurements obtained from physical systems; s ( n ) is a set of measured values. 

Measurements are considered as a set of s(n + T) after T time delay. The 
average mutual function information between n and n + T is average value of 
s(n + T) which obtained by values of s(n) ', 



/(T) = £p(5(n),*(» + r))log : 



P(s(n),s(n + T)) 
P(s(n))P(s(n + T)) 



I(T) > (3) 



The best estimation for x, proposed by Fraser and Swinney, is the first local 
minimum value of the mutual information. The mutual information is a measure 
of how much information can be predicted about one time series point included 
all the necessary about others [11,13]. In our study, time delay value has been 
found as 12 time point, as seen Figure 3. 




10 20 30 40 50 60 70 

Time Delay (sn) 



Fig. 3. Time Delay values for mitral valve Doppler signals from healthy subject 
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2.2.3. Determining Embedded Dimension 

The aim of the phase space reconstruction is to provide a large enough 
Euclidian space {Rm) ■ This process supports system's attractor without any 
ambiguity. The higher values of m, two nearest point can be seen in m dimension 
[12]. In Rm space all the ambiguities can be solve. We can use Cao's method 
[14] to determine the embedded dimension. According to this method, the 
difference between the nearest neighborhood pairs in the yim) where m is the 

embedded dimension and y (m + 1) where m + 1 is the embedded dimension. 



T is the time delay of phase space, 
given that; 



shows the Euclidian difference, It is 



y ; - (m + 1) -;y„ (! - m) (m + l) 



a(i, m) = 

\\yiOn)-y n(iim) (m)\\ 

i = 1,2,..., N-mT 



(4) 



y k (d)-y l (d)= max 

0<j<d-l 



X k+jT X l+jT 



(5) 



If m value is determined successfully, any two points are close to each other in m 
dimension, It has been close in the constructed phase space of m + 1 dimension 
too [14]. This type of couple of points are called right neighbors, otherwise they 
are called wrong neighbors. If there is a wrong neighborhood, a(i,m) value is 
too different from calculated threshold value. Threshold value Eim) can be 
obtained with average of all the a(i,m) ■ 



E(m) ■■ 



1 



N-mT 



ZN-ml 
a(i,m) 



(6) 



Where, Eim) value depends on m dimension and T time delay. 
In our study Cao's method has been applied to Doppler signal to find embedding 
dimension. The embedding dimension values have been determined as m =8. We 
can see the minimum embedding dimension curve from Doppler signals in the 
Figure 4. 
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Fig 
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4. The minimum embedding dimension curve 



2.2.4. Lyanupov Exponentials 

For a time series, two important indexes to identify the chaotic behavior are its 
mutual dimension and maximum Lyapunov exponents [9]. Lyapunov exponents 
determine the nearby phase space trajectories between average exponential 
separation. The generic mechanism to compose deterministic randomness and 
unpredictability is the exponential divergence of initially nearby trajectories in 
phase space coupled with folding trajectories. [10,15]. 

For a small dimensional deterministic process, the Lyapunov exponents should 
be a positive finite number. For a linear process, it should be zero and for a 
scholastic process it should be infinite [15]. In an chaotic attractor, the maximal 
Lyapunov exponent must be greater than zero which means that the neighboring 
trajectories of the attractor are locally diverging in at least one direction of the 
phase space [16]. 

Rosentein et al. [17] proposed a method to calculate the largest Lyapunov 
exponent from an observed time series. In this method, following S value is 
computed for different N values: 



S(t) ■■ 




'n+l 



(7) 



If S exhibits a linear increase with an identical slope, this slope can be taken as 
an estimate of the maximal Lyapunov exponent [16]. 

The maximum Lyapunov exponent curves belonging to patient and healthy 
subject are seen in Figure 5. 
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1000 2000 3000 4000 5000 6000 7000 

Number of Iteration 

Fig. 5. The maximum Lyapunov exponent curve for the patient and healthy subject 

3. Results and Discussion 

In our study, It was determined that, nonlinear behaviors of mitral valve Doppler 
ultrasound signals. In reconstructed eight dimension phase space the time delay 
and embedded dimension have been derived also, correlation dimension and 
Lyapunov exponents have been calculated from time series Doppler signals. 
Maximum Layapunov exponent values and the maximum correlation dimension 
values are given in Table 1 . 

Table 1 . Maximum Lyapunov Exponent and Correlation Dimension Values 





Healthy Subject 


Patient Subject 




Meanistd 


Meanistd 


Max. Lyap. 
Exponent 


2.6175± 0.2319 


5.6860+0.6922 


Max. Fractal 
Dimension 


2.0433+0.1936 


0.891 1±0.08640 



The maximum values of Lyapunov exponent for the Doppler signals from mitral 
valve stenosis patient subjects have been obtained as 5.6860+0.6922 and for the 
Doppler signals from mitral valve healthy subjects have been obtained as 
2.6175+ 0.2319. The increment in maximum Lyapunov exponent derived from 
patient subjects indicates the increasing of the chaotic behavior than maximum 
Lyapunov exponent derived from healthy subjects .The higher value of 
maximum Lyapunov exponent imply randomness and unpredictability in the 
long term which can also be observed from the sonogram in Fig. 2. On the other 
side, the lower values of the maximum Lyapunov exponent from healthy 
subjects imply more considerable periodicity which can also be detected from 
the sonograms in Figure 1. According to our nonlinear analysis, it has been 
shown that all the Doppler time series signals are not only nonlinear, but also it 
can be supposed as stationary in certain time interval. This means that the 
nonlinear methods have been applied to estimate the invariant measures like 
correlation dimension and maximum Lyapunov exponent. 
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The correlation dimension values have been calculated as 2.0433+0.1936 for 
healthy subject and 0.8911+0.08640 for the patient with mitral valve stenosis. 
This paper indicated that the two chaotic invariant measures, maximum 
Lyapunov exponent and correlation dimension have been pointed out the 
unpredictibility and complexity levels of the mitral valve Doppler signals, 
respectively. The chaotic measures of the Doppler signals are useful to describe 
cardiovascular regulation. Ongoing trials the classification studies can be made 
using more subjects. 
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Abstract 

In this paper we consider the Ising model with spin values in $ = { — 1, 1}, the relevant Hamilto- 
nian with competing binary nearest-neighbor, prolonged ternary and prolonged next-nearest neighbors 
interactions has the form 

H(a) = -j p Y^ a ( x ) a (y) - J tYl a ( x ) a (y) a ( z ) — ^i 5Z a ( x ) a (y)' 

>x~y< >x,y,z< <x,y> 

where J p ,Jt,J\ £ K are coupling constants. We study the phase diagram of this model. To perform this 
study, an iterative scheme similar to that appearing in real space renormalization group frameworks is 
established. At vanishing temperature, the phase diagram is fully determined for all values and signs 
of Ji,Jt and J p . At finite temperatures several interesting features are exhibited for typical values of 
— Jt/Ji and Jp/Ji- 

PACS: 05.50.+q, 64.60.-i, 64.60.De, 75.10.Hk 

Keywords: Ising model, Cayley tree, phase diagram, ternary neighbors, modulated phase, Lifshitz 

point. 

1 Introduction 

Complex phase diagrams with a variety of transition lines and modulated phases are obtained via the 
presence of competing interactions in magnetic and ferroelectric systems. The ANNNI (Axial Next-Nearest- 
Neighbor Ising) model, which consists of an Ising spin Hamiltonian on a Cayley tree, with ferromagnetic 
interactions on the planes, and competing ferromagnetic and antiferromagnetic interactions between nearest 
and next-nearest neighbors along an axial direction, is known to reproduce some features of these complex 
phase diagrams [1] . The Ising model on a Cayley tree of order k with competing interactions has recently 
been studied extensively because of the appearance of nontrivial magnetic ordcrings [2] (see also references 
in [2]). Also, the Ising model has found some applications physical, chemical and biological systems, and 
even in sociology. The Cayley tree is not a realistic lattice; however, its amazing topology makes the exact 
calculation of various quantities possible. For many problems the solution on a tree is much simpler than 
on a regular lattice and is equivalent to the standard Bethe-Peierls theory [5]. In the literature, it has 
been working many different lattice types similar to Cayley trees [6, 7, 13, 14, 15, 16, 17]. As initiated by 
Vannimenus [2] , a Cayley tree is a counterpart of the ANNNI (Axial Next-Nearest-Neighbor Ising) model, 
which is used to provide an approximate description of some materials, such as CESb [8] and ferroelectric 
NaN02 [9]. In recent years, investigation of phase diagrams of the Ising model has attracted increased 
attention [10, 11, 12]. 
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On the Cayley tree one can consider two type of ncxt-nearest-ncighbors: prolonged and one- level ncxt- 
nearest-neighbors. In the case of the Ising model on the Cayley tree with competing nearest-neighbor 
interactions J\ and prolonged next-nearest-neighbor interactions J p , Vannimcnus [2] was able to find new 
modulated (M) phases, in addition to the expected paramagnetic (P) and ferromagnetic (F) ones. From 
this result follows that Ising model with competing interactions on a Cayley tree is real interest since it 
has many similarities with models on periodic lattices. In fact, it has many common features with them, 
in particular the existence of a M phase, and shows no sign of pathological behavior at least no more than 
mean-field theories of similar systems [2]. Inawashiro et al [18, 19] independently of Vannimenus investigated 
the Ising model with nearest-neighbors and prolonged next-nearest-neighbors interactions on a Cayley tree, 
but they allowed J p — J , where J is the one-level next-nearest-neighbor interaction on Cayley tree. Mariz 
et al [20] extended this results assuming existence also binary interaction J on Cayley tree of order 2. Later 
da Silva et al [25] investigated the Ising model on the Cayley tree of general connectivity with competing 
interactions between the first-, second-, and third-neighbor spin generation. 

The aim of this paper is to extend Ganikhodjaev and Akin [4] results on Cayley tree by adding prolonged 
next-nearest-neighbor interactions. By changing J p (prolonged next-nearest-neighbor interactions) and Jt 
(prolonged ternary interactions) values, a new model is obtained. We combine the parameters in [2] and 
[4]. Here by using the similar computational techniques as in [2, 20, 27], we describe the phase diagrams of 
an Ising model on a Cayley tree with competing nearest-neighbor J\, prolonged ternary J t and prolonged 
next-nearest-neighbor interactions J p . 

The outline of this paper is given as follows: we set up the basic definitions of our model in Section 2 
and the recurrence relations are obtained in Section 3. Section 4 is devoted to the analysis of the phase 
diagrams. Finally, the conclusions are presented in Section 5. 

2 Definitions 

2.1 Cayley tree 

A Cayley tree T k of order k > 1 is an infinite tree, i.e., a graph without cycles with exactly fe + 1 edges issuing 
from each vertex. Let denote the Cayley tree as T k = (V, A), where V is the set of vertices of T k , A is the set of 
edges of T k . The distance d(x,y),x,y £ V, on the Cayley tree T k , is the number of edges in the shortest path 
from x to y. For a fixed x £ V we set W n = {x £ V\d(x, x ) = n}, V n = {x £ V\d(x, x ) < n} = 1J™ =0 Wi, 
and L n denotes the set of edges in V n . The fixed vertex x is called the 0-th level and the vertices in W n 
are called the n-th level. For the sake of simplicity we put |x| = d(x, xo), x £ V. 

Two vertices x and y, x, y £ V are called nearest-neighbors if there exists an edge / £ A connecting them, 
which is denoted by I =< x, y >. Two vertices x, y £ V are called the next-nearest-neighbors if d{x, y) = 2. 
The next-nearest-neighbor vertices x and y are called prolonged next-nearest-neighbors if |x| ^ \y\ and is 
denoted by > x, y < (see [2]). Three vertices x, y and z are called a triple of neighbors and they are denoted 
by < x, y, z >, if < x, y >, < y, z > are nearest neighbors. The triple of vertices x, y, z is called prolonged if 
x £ W n , y £ W n +i and z £ W n +2 for some nonnegative integer n and is denoted by < x, y, z > (sec [4]). 

2.2 Ising model 

For the Ising model with spin values in $ = { — 1,1}, the relevant Hamiltonian with competing nearest- 
neighbor Ji, prolonged next-nearest-ncighbor binary interactions J pi one-level next-nearest-neighbor binary 
interactions J , and one-level next-nearest-neighbor quadruple interactions J; x has the form 

H(a) = -j t Y^ v{x)v{y) - J P Yl cr ( x ) (T (y) " J »E <r(x)v(y) 

<x,y> y^Tyk >x~y< 

-Jt Y (J ( x ) <J (y) <J ( z ) - J h Yl cr(x)a(y)a(z)a{t) (1) 

>x^y~z< >x,y,z,t< 

where J\, J p , J 0l Jt, Ji x £ R are coupling constants. 

In the case of J p — Jt — Jh = 0, Ising model (1) is exactly solvable [21] and its phase diagram consists 
of ferromagnetic and antiferromagnetic phases only. In the presence of J p with J = J t = Ji x =0 this 
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model was considered by Vannimcnus [2]. He proved that phase diagram contains new modulated phase 
with the expected paramagnetic and ferromagnetic ones. The case Jt = Ji x = with binary interaction of 
J on Cayley tree of order 2 was considered in [20] and the case J p = Ji ± = J = 0, the Ising model (1) was 
studied in [4]. 

Below we consider model (1) with J = Ji t = on a Cayley tree of second order and clarify the role of 
prolonged triple interaction J t 7^ . 

3 Basic Equations 

In order to produce the recurrent equations, we consider the relation of the partition function on V n to the 
partition function on subsets of V n -\. Given the initial conditions on V\, the recurrence equations indicate 
how their influence propagates down the triangular chandelier. Let 

Z<") ( . *°. ) (2) 

be the partition function on V n where the spin in the root xq is io and the 2 spins in the proceeding ones 
are ii,i 2 - 

There are 6 different partition functions of such form. We define for convenience the following variables: 

One gets through a direct enumeration: 



z[ = a 2 {b 2 c 2 z 1 + 2z 2 + b- 2 c- 2 z 3 ) 2 

4 = (b 2 c 2 z 1 +2z 2 + b- 2 c- 2 z 3 )(b 2 cr 2 z 4 + 2z 5 + b- 2 c 2 z 6 ) 
1 



I -2/i2 -2 10 1 7,-2 2 \2 

z 3 = a (be Z4 + ZZ5 + b c Zq) 



z' 4 = a- 2 {b- 2 c- 2 z 1 + 2z 2 + b 2 c 2 z 3 ) 2 

z' 5 = (b- 2 c- 2 z 1 + 2z 2 + b 2 c 2 z 3 )(b- 2 c 2 z 4 + 2z 5 + b 2 c- 2 Z( i ) 

Zg = a 2 (b^ 2 c 2 z 4 + 2z 5 + b 2 rr 2 z 6 ) 2 , 

where primed variables (z[, z' 2l ...) correspond to the partition functions (2) on VL + i), and the interactions 
appear through the parameters 

a = exp(J 1 /T), b = cxp(J p /T), c = exp(J t /T). (4) 

Note that z 2 — z[z 3 , and z' 5 = z' A z' & , only four independent variables remain, and through the introduction 
of the new variables ui = sfzl, we produce the following recurrence system: 

l2^2„ 2 1 r, 1 r — 2„— 2 rt 2\ 



U\ = a{b z c z u{ + 2uiu 3 + b z c A u 3 ) 



I -1/1,2 — 2 2 i r, , 7—2 2 2\ 

u 3 = a (be u 4 + ZU4UQ + b c u 6 ) 



u' 4 = a 1 (b 2 c 2 u\ + 2uiu 3 + b 2 c 2 u\) 

I (1.—1 2 2,o 1 j,2 -2 2\ 

m 6 = a(b cu 4 + 2u4Us + bc u e ). 

The total partition function is given in terms of (m) by Z^> = [u\ + u 3 ) 2 + (114 + uq) 2 . For discussing the 
phase diagram, the following choice of reduced variables is convenient: 

U 3 + M4 Ml — Mg U 3 — U4 

X = : , V\ = : , V2 = : • 

Ul + Uq Ml + Mg Ml + M 6 

The variable x is just a measure of the frustration of the nearest-neighbor bonds and is not an order 
parameter like y\,y 2 . 
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The relations now have following form: 

x ' = T^D \Ai{x,yi,y 2 ) + A 2 (x,yi,y 2 )\ 

v'i = h [^3(^,^1,2/2)- Ai{x,yi, 2/2)] 
y'2 = w5[Ai(x,yi,y2)-A 2 (x,yi,y 2 )] 



(5) 



where 



A 1 (x,yi,y 2 ) = b 2 c- 2 (x-y 2 ) 2 + 2{x-y 2 )(l-yi)+ b' 2 c 2 (I - Vl f 

A 2 (x,y t ,y 2 ) = b- 2 c- 2 (l + y 1 ) 2 + 2(l + y 1 )(x + y 2 )+b 2 c 2 (x + y 2 ) 2 

A 3 (x,yi,y 2 ) = b 2 c 2 {l + y 1 ) 2 + 2(l + y 1 )(x + y 2 )+b- 2 c- 2 {x + y 2 ) 2 

A 4 (x, yi ,y 2 ) = b- 2 c 2 {x-y 2 ) 2 + 2(x-y 2 )(l-y 1 )+b 2 c- 2 {l-y 1 ) 2 

D{x,y u y 2 ) = A 3 (x,y 1 ,y 2 )+A 4 (x,y 1 ,y 2 ). 



The average magnetization m for the nth generation are defined by 



(l + x + yi +y 2 ) 2 -(l + . 



2/1 - 2/2J 



(1 + x + j/i + y 2 ) 2 + (1 + x - 2/1 - y 2 ) ; 



= 2 



(l + a:)(i/i 



2/2 J 



(1 + s) 2 + {y x + y 2 ) 



2 ' 



4 Analysis of the phase diagrams 



In this section we present a qualitative study of the exact phase diagrams of the model (1) in the space 
(a,/3,7) space for given some fixed j3 and 7, where TjJ\ — a, —J v jJ\ — P, Jt/Ji = 7 and respectively 
a = exp(a _1 ), b = exp(— a~ l f3) and c = exp(a~ 1 j). A phase diagram of a model describes a morphology 
of phases, transitions from one phase to another, stability of phases and corresponding transitions line. It 
is convenient to know the broad features of the phase diagram before discussing the different transitions 
in more detail. This can be achieved numerically in a straightforward fashion. The recursion relations 
(5) provide us the numerically exact phase diagrams in (T/Ji, — J p /J\, Jt/Ji) space. Starting from initial 
conditions 
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Figure 1: Phase diagrams of the model for 7 = 0, 7 = 0.001 and 7 = —0.001. 



,(i) 



2 A ' Vl 

a z c^ 



(i) 



b 4 + r 



y-2 



(i) 



6 4 + l 



(6) 



that corresponds to positive boundary condition a^ n '{V \V n ) = 1, one iterates the recurrence relations 
(5) and observes their behavior after a large number of iterations. In the simplest situation a fixed point 
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Figure 2: Phase diagrams of the model for 7 = 0.5 and 7 = —0.5. 

(x* , y\ , 1/2) is reached. It corresponds to a paramagnetic phase if y\ — 0, y% = or to a ferromagnetic phase 
if 2/i j 2/2 7^ 0- The system may be periodic with period p, where case p = 2 corresponds to antiferromagnetic 
(AF) phase and case p = 4 corresponds to so-called antiphase, that denoted < 2 > for compactness. 
Finally, the system may remain aperiodic. The distinction between a truly aperiodic case and one with a 
very long period is difficult to make numerically. Detailed information about the phases and the relation 
with partition functions, we mainly refer to works given by Vannimcnus [2] and Mariz et al [20]. Below we 
consider periodic phases with period p (briefly P2-P12) where p < 12. We will consider all periodic phases 
with period p > 12 and aperiodic phase as modulated M phase. 

Below we clarify the role of the parameters 7 = Jt/Ji and f3 — —J p jJ\. The resultant phase diagrams 
for some values of 7 are shown in Fig. 1-4 with — 2 < a, (3 < 2. In Fig. 1 the case 7 = corresponds to the 
Vannimenus's phase diagram [2]. For 7 7^ (see Figures 1-4) one can see that corresponding phase diagram 
does not contain P phase. For the values I7I = 0.001 and I7I = 0.5 given in Fig. 1 and Fig. 2 respectively, 
the P phase disappears suddenly. For the case I7I = 0.001, in the third quadrant, instead of P phase, the 
F phase appears. That is, P region is replaced by the F region. 

Here we have three multicritical points (LP): (T = 0;-J p /Ji = 0.3), (T/Ji = -0.04;- J p /Ji = -0.3) 
and (T/Ji = -0.2; -J p /Ji = -0.25). 

In Fig. 2 for I7I = 0.5, in the first quadrant, while region M is narrowed, in the third quadrant the region 
P3 is extended. In first quadrant (Jt < 0; J\ > 0), the diagram consists of three phases: F, P4 and M, 
three of them meeting at the multicritical point (T = 0; —J p /J\ = 0.6). In second quadrant (J t > 0; J\ > 0), 
the diagram consists of F phase only. 

In third and fourth quadrants, phase diagram consists of mainly F, AF, P3 and M phases. Also, we 
have P7 as an island in third quadrant. Here we have many multicritical points, some of these multicritical 
LPs occur at non-zero temperature (T '/ ' J\ = — 0.15;— J p /J\ = —1), (T/Ji = — 1.1;— J P /J\ = 0.1) and 
(T/Ji = -0.5;-J p /Ji = 0.1). 

In Fig. 3, for values 7 = 0.8 and 7 = —0.8 the figures are changed considerable. For 7 = 0.8, we have 
many multicritical points, six of these multicritical LPs occur at zero temperature (T ' / ' J\ = 0; —J p /J\ = 0.8), 
{T/'.h = 0; -Jp/Ji = 0.5), (T/Ji = 0; -Jp/Ji = 0.2), (T/Ji = 0; -J p /J x = -0.45), {T^h - 0; -Jp/Ji = 
— 1.26) and (T / J\ — 0;—J p /Ji = —1-4), some LPs occur at non-zero temperature. For 7 = —0.8, the 
phase diagram has similar properties. In Fig. 4, for values 7 = 1 and 7 = — 1 the figures are changed 
completely. For 7 = 1, we have many multicritical points, three of these multicritical LPs occur at zero 
temperature {T/J 1 = 0;-J p /J 1 = 0.2), (T/Ji = 0;-J p /Ji = -0.65) and (T/J 1 = 0;-J p /J 1 = -1.3), LPs 
(T/Ji = 0.2;- Jp/Jx = 1), (T/Ji = 0.2;- Jp/Ji = -0.7), (T/J x = -1.7; -Jp/Ji = 0.2) occur at non-zero 
temperature. For 7 = —1, the phase diagram has similar properties. 

The resultant phase diagrams for some values of f3 are shown in Fig. 5-8 with —2 < a, 7 < 2. In Fig. 5 
for /? = 0, we obtain the phase diagram of our model which is given also in [4]. Here we have four phases: 
F, P2, P4 and M phases. 

Consider the case |/3| = 0.3 (Fig. 5). For (3 — 0.3 we have six multicritical LPs, two of them is at zero 
temperature: (T/Ji = Q,J t /Ji = 0.72) and (T/Ji = 0,J t /Ji = -0.72). The other LPs are at nonzero 
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Figure 3: Phase diagrams of the model for 7 = 0.8 and 7 = — 0. 
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Figure 4: Phase diagrams of the model for 7 = 1 and 7 = — 1. 
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Figure 5: Phase diagram of the model for /3 = 0, /3 = 0.3 and (3 = —0.3. 
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temperature: {T/J x = -0.1, J t /Ji = -0.72), (T/Ji = -1.15, J t /Ji = -0.65), (T/Ji = -0.42, J t /J x = 0.72) 
and (T/Ji = —1.15, Jt/Ji = 0.<?5). For /3 = —0.3, the P2 phase disappears suddenly, a new figure of phases 
appears as a tower in the third and fourth quadrants. 
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Figure 6: Phase diagrams of the model for j3 = 0.5 and (3 = —0.5. 

In Fig. 6, the P4 phase appears. For (3 = 0.5, the phase diagram is changed in the first and second quad- 
rants. Also, we have many multicritical LPs. In the fourth quadrant, the M phase disappears completely. 
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Figure 7: Phase diagrams of the model for f3 = 0.8, (3 = —0.8 and (3=1. 

In Fig. 7, for (3 = 0.8, in the first and second quadrants the P4 phase region is expanded. Similarly, 
for (3 = —0.8 the P4 phase region is expanded in the third and fourth quadrants. Also, we have many 
multicritical LPs and the phase diagrams consist of a some numbers of islands with different phases inside 
the M phase region. 

In Fig. 7 and Fig. 8, one can observe that the phase diagrams are changed considerable; the P4 phase 
region is expanded. For \(3\ = 1.5, one can see a new phase: the P6 phase emerges as small islands. 
Analytical investigation on the stability of fixed points (paramagnetic, ferromagnetic and modulated) given 
in equations (5) left to another publication. The transition lines between the phases will also be considered 
later on. 

5 Conclusions 

We have found exact phase diagrams of the Ising model with competing prolonged and ternary next nearest- 
neighbor and nearest-neighbor on the Cay ley tree of order 2. The basic equations produced for Ising model 
with competing interactions mentioned above are essentially complete than similar equations produced in 
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Figure 8: Phase diagrams of the model for (3 = — 1, (3 — 1.5 and (3 = —1.5. 

[2], [18] and [20]. In [2], there are four phases P, F, P4 and M. In [4], there are also four phases F, P2, 
P4 and M only. One can find the multicritical Lifshitz points [24] that are at nonzero temperature. It 
appears to shift the multicritical Lifshitz to finite temperature, while it was stuck at zero temperature T 
for all systems with competing interactions, studied on the Cayley tree previously [2] and [20]. Finally the 
study of additional aspects [24, 26] of this and related models is planned to be the subject of forthcoming 
publications. 
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Abstract 

In order to decode a chaotic attractor of an autonomous dynamical 
system, it's necessary to find as many periodic solutions as possible. Usu- 
ally all periodic solutions are unstable and all together they form a fractal 
structure in multi-dimensional space. To localize solutions many meth- 
ods require a lot of calculations. The following approach is based on the 
clusterization of non-invariant manifold on the Poincare section, which all 
periodic solutions pass through. Such approach not only faster, but also 
the process can be parallelized. 

Keywords: unstable, periodic, cluster, localization, chaos 

In this article there will be described an approach to localize periodical 
solutions in a chaotic or a high-order periodical attractor of an autonomous 
dynamical system. For clearness we will conceder the approach on the example 
of the Rossler system: 

x' t = -y - z, 

V't = x + ay, (1) 

z' t = b + z(x — /i), 

where the system parameters are chosen as a = |, b = § and c = 2.375. In this 
system the chaotic motion is present and it's widely studied [1, 2, 3]. There ex- 
ists a supposition that states that all unstable periodical solutions giving birth 
to the chaotic attractor passes though one-dimensional non-invariant manifold. 
This condition is not obligatory, but it's significantly reduce the time of compu- 
tation. In the Rossler system there exists a Poincare section such that points of 
intersection of unstable periodic solutions with the section form one dimensional 
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Figure 1: Rossler chaotic attractor, the Poincare section and the non-invariant 
one dimensional manifold. 



manifold. The chosen Poincare section contains two equilibria points of the sys- 
tem. The set of points of intersection of the Rossler chaotic attractor with the 
section lies on one dimensional smooth curve (fig. 1). Starting from any point 
on the curve after one turn the Rossler dynamical system brings it back on 
the curve when it crosses the Poincare section. That allows us to consider the 
Poincare map Pu, where u = (x, y, z) is a point, as one dimensional map on the 
tree dimensional curve. And the Poincare map Pu defines connections between 
points u on the curve. 

The chosen Poincare section simplifies the problem from unbounded tree 
dimensional to bounded one dimensional search. It's well known that unstable 
periodic solutions of Rossler attractor organize a fractal structure on the non- 
invariant curve. Thus in order to find periodical solutions the clusterization 
method is appropriate. Let's take N equally spaced points Ui,...,uat on the 
curve. And each point has it's Poincare map Pu^. All pairs (uj,Puj) are 
unique. Using the Euclidean distance between pairs the set of pairs can be 
clusterized in such a way that in one cluster there were only pairs with near 
start points Uj and near its Poincare map points Pu^ [4, 5]. Start points from 
one cluster can have its Poincare map near start points of the other clusters. 
This relation between clusters gives an oriented graph. One cluster of points 
C\ has oriented connection with another cluster C\ — > C*2, if they fulfill the 
following condition: 



mm 

UiGCi,u 2 eC2 



PU,; - U.,11 < 5, 



(2) 



where C\ is a set of starts points from one cluster and C'2 - starts points from 
the related cluster. The parameter S should be as small as distance between 
start points: § w ||ui — Uj||, i ^ j. 

In the Rossler case taking only 200 start points and corresponding its Poincare 
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(a) Oriented graph of clusters (b) Cluster number 5. Green points are 

start points and red points are Poincare 
map points. 

Figure 2: Clusters of the non- invariant curve of a chaotic attractor of the Rossler 
system. 



map points one can divide them by 17 clusters and using the relation condition 
Eqs.2 draw connections between clusters (fig. 2a). The derived graph is fully 
connected and there are 62 simple cycles. We'll search periodic solutions of the 
Rossler system in subgraphs connected in cycles. In other words a periodical so- 
lution can pass many times any simple cycle of connected clusters in the graph. 
The simplest case is the self connected cycle {5} of the length 1 (fig. 2b). After 
the filtering points which are not connected to the cluster 5 there are left only 
4 points, which potentially can represent a periodic solution. These 4 points 
are corresponded to a small range on the curve. In order to increase precision 
one can chose new discretization of the new range with a smaller step between 
points, for example, up to 200 points. With the new set of start points and 
its Poincare map points we repeat again the clusterization and we draw a new 
graph, and so on. In the chosen cycle {5} of the original graph this process 
will lead to a self connected subgraph corresponding to a range on the curve, 
which tends to zero by norm. It means that the periodic solution of period one 
is localized (fig. 3a). 

In case if there are more than one cluster in a cycle, for example, {1, 15} 
of the graph (fig. 2), after the filtering and the extension of start points each 
of clusters can be subclusterized separately or united and then reclustcrizcd. 
Using reclustcrization approach there were found another periodic solutions of 
period 4, 6, 8 etc (fig. 3). 

In many systems there exists more than one dimensional non-invariant man- 
ifold on the Poincare section. This approach to search of unstable periodic 
solutions is still valid. The only difference is that start points {u} should be 
taken inside the attractor bonding tori on a Poincare section. All points from 
the invariant manifold will be rejected at the filtering stage. 
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(a) Period one 



(b) Period two 



(c) Period four 





(d) Period six 



(e) Period six 



(f) Period eight 



Figure 3: Periodical solution in the Rossler chaotic system, (a): x « —1.71327, 
y « -0.55776 and z w 0.187936; (b): x « -2.42754, y « -0.669782 and 
z « 0.156963; (c): x « -0.767252, y « -1.6213 and 2 « 1.32838; (d): x « 
-1.82617, y « -0.573996 and z « 0.181707; (e): a: « -1.55795, j/ w -0.538524 
and z ~ 0.199319; (f): x « -1.32721, y sw -0.51608 and z w 0.221794. 
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Abstract 

In this work, we investigate how a focused time-lagged recurrent neural network topology can 
be efficiently configured based on the complexity of the underlying dynamics reflected by the 
observed chaotic time series of a Chua's electronic circuit. In particular, we examine the possibility 
to partition the input space by the number of near neighbours of the chaotic time series being 
modelled. By determining the number of near neighbours, the number of hidden units can then be 
specified. The validity of such an approach is examined by changing the number of neurons in the 
hidden layer. 

Keywords: Chaos, Chua's Circuit, Neural Networks, Time Series Analysis. 



1. Introduction 

It is well known that neural networks are used for time series prediction problems. Many 
architecture schemes have been considered for such predictions, but in general time lagged 
recurrent neural networks give better results. Despite the neural network architecture, the 
definition of number of hidden units as well as the number of input variables remains as an open 
problem. In this work, we examine how we can specify the number of hidden units by the number 
of near neighbours. In other words, we investigate how a focused time-lagged recurrent neural 
network (FTLRNN) can be efficiently determined based on the complexity of the underlying 
dynamics reflected by an observed chaotic time series, and for this, we have chosen to use the 
output voltage of a Chua's electronic circuit. 

Chaotic electronic circuits [l]-[4] have been widely studied during the last few decades due to 
their easy implementation, robustness, reproducibility of results, and also as a test platform for 
synchronization, chaos control, signal encryption and secure communications [5]-[ll]. The Chua's 
circuit [12], [13] is one of the most famous circuits in this research area's literature. Here, we 
consider a typical implementation of the Chua's circuit and examine its operation in the MultiSim 
circuit simulation environment, as illustrated in Fig.l, by monitoring the voltage, u, across the 
resistor R 7 of the circuit. As shown in Fig.2, the so obtained voltage u=u(t) time series clearly 
reveals the presence of chaos. 
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Figure 1: MultiSim simulation environment for the considered Chua circuit. 
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Figure 2: The simulation obtained chaotic signal u=u(t) across the resistor R 7 of the Chua circuit of Figure 1. 

Using the recorded data, we now construct a vector X { , ;-l,..,N, where N=2870 data values in 
the m dimensional phase space, given in the form, [14]: 



Xj — {'0;,Di_ r ,'Ui_2r,---,'Ui+(„,-l)r} 



(1) 



This vector represents a point in the m dimensional phase space, the attractor of which is 
embedded each time, where x is the time delay r=iAt and zli=9.76us is the sample rate. The 
element rj, represents a value of the examined scalar time series in time, i.e. the voltage u across 
the resistor R 7 corresponding to the ;'-th component of the time series. Use of this method reduces 
the problem of phase space reconstruction to that of proper determining suitable values of m and r. 
The choice of these values is not always simple, especially when we do not have any additional 
information about the original system and the only source of data is a simple sequence of scalar 
values, acquired from the original system. The dimension for which a time delay reconstruction of 
the phase space provides the necessary number of coordinates to unfold the dynamics from 
overlapping on itself as caused by projection, is called embedding dimension m. Using the average 
mutual information we can obtain r, being less associated with a linear point of view, and thus, 
more suitable for dealing with nonlinear problems. Following that, the average mutual 
information, I(x), [14], expresses the amount of information (in bits) which can be extracted from 
the value in time u, about the value in time u,-+ r . Usually, the value of r suitable for the phase space 
reconstruction chosen is equal to the position of the first minimum oflfz), [14]. Here, r =14 time 
steps, as shown in Fig. 3. 
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Figure 3: Mutual information / versus the time delay x. 



Next, we use the method of False Nearest Neighbours (FNN), [14], [15], in order to estimate 
the minimum embedding dimension. This method is based on the fact that when embedding 
dimension is too low, the trajectory in the phase space will cross itself. If we are able to detect 
these crossings, we may decide whether the used m is large enough for proper reconstruction of 
the original phase space, i.e. when no intersections occur, or not. When intersections are present 
for a given m, the embedding dimension is considered too low and we have to increase it at least 
by one. Then, we test the eventual presence of self-crossings again. 

The practical realization of the described method is based on testing the neighbouring points 
in the m-dimensional phase space. Typically, we take a certain amount of points in the phase space 
and find the nearest neighbour to each of them. Then, we compute distances for all these pairs and 
also their distances in an (/«+l)-dimensional phase space. The rate of those distances is 



\x,{m+\)-X^(m+\) 

\\ Xj(tn)- X^Jwjl 



(2) 



where X^mj represents the reconstructed vector as described in (1), belonging to the z'-th point in 
the m-dimensional phase space and index n(i) denotes the nearest neighbour to the z'-th point. If P 
is greater than some value -Pmax, we call this pair of points false nearest neighbours, i.e. neighbours 
which arise from trajectory self-intersection and not from the closeness in the original phase space. 
The dimension m is considered found only when the false nearest neighbours percentage falls 
below some limit, typically set to 1%, [16]. Hence, choosing an implicit value P max = ^0, we can 
finally calculate the quantity P. 

The considered Chua's circuit is a 3-variable system and this means that the false nearest 
neighbour number should indicate the minimum embedding dimension to be equal to m=3, [13]. 
This is shown in Fig.4, where the obtained results indicate that application of FNN yields m=3, 
confirming that Chua's circuit is a 3-variable system. 
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Figure 4: False nearest neighbour ratio as a function of the embedding dimension: false nearest neighbours 
become negligible after m = 3. 
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2. Time-lagged recurrent neural network structure 

Time-lagged recurrent networks (TLRNs), [17], [18] are multilayer perception (MLP) neural 
networks extended with short-term memory structures, [19], [20], since most chaotic data contain 
valuable information in their time structure, i.e. how data change with time. Hence, TLRNs can 
capture the dynamics of chaotic data. Recurrent networks are neural networks with one or more 
feedback loops, while the memory structure is simply a cascade either of ideal delays, i.e. a delay 
of one sample, or of leaky integrators, called in this case gamma memory. When an input 
processing element (PE) of an MLP neutral network is replaced by a tapped delay line, the neutral 
network is characterized as focused and the topology is called focused because memory elements 
are present only at the input layer, [21], while it is clear that such a delay line holds or stores the 
past input samples. Following that, the combination of tap delay lines and the weights that connect 
the taps to the PEs of the first hidden layer can be seen as simple linear combiners followed by a 
static nonlinearity. Hence, the first layer of a neural network may act as a filtering layer with as 
many adaptive filters as PEs in the first hidden layer. The samples' depth parameter (D) is used to 
compute the number of taps (7) contained within the memory structure of the network. A typical 
time-lagged neural network structure is shown in Fig. 5. 




x(n-k) 



Figure 5: A time-lagged neural network with one hidden layer where z is the operator (linear system) that 
delays the input by one sample without distorting it. 

In order to forecast the chaotic time series obtained from the Chua circuit, we construct a 
focused time-lagged (delay) neural network with one hidden layer. The number of inputs is set 
equal to the embedding dimension m=3, while the number of hidden layer neurons is obtained by 
specifying the number of near neighbours of each order. Furthermore, in order to examine the 
influence of this number into the prediction of the chaotic time series, we need to find the 
corresponding number. Thus, by applying the method proposed by [14] and [16] for a minimum 
embedding dimension m=i and a delay time z=14 of the considered circuit, it is found that: 

• for radius e = 0.02 1 6, the number of first order nearest neighbours is 41 , 

• for radius e = 0.03068, the number of second order nearest neighbours is 119, 

• for radius s = 0.0433, the number of third order nearest neighbours is 283, 

• for radius s = 0.0612, the number of forth order nearest neighbours is 683. 

In this respect, we now test the efficiency of the network with number of hidden layer neurons 
equal to the minimum embedding dimension, i.e. being equal to 3. In addition, we apply the 
Kolmogorov theorem, [22], according to which the number of hidden layer neurons is equal to 
2m+l=2x3+l=7. We choose the transfer function to be the tanh(j and we consider gamma 
memory, i.e. leaky integrators in the delay line. The depth in samples D that is used to compute the 
number of taps contained within the memory structure of the network is set equal to the 
embedding minimum dimension m, i.e. D=3, while the trajectory length Tthat corresponds to the 
samples/exemplar setting within the dynamic controller and specifies how many samples to read, 
i.e. steps in time to move forward, before back propagation occurs, is chosen to be 2m, i.e. T=6. 
The efficiency of the network is then measured by applying mean square error (MSE) for training 
[23], and normalized mean square error (NMSE) [23] for testing set. For learning purposes we use 
65% percent of our data, 15% for cross validation and 25% for testing. In all cases the learning 
process stopped at 10000 epochs with a learning rate equal to 0.1 and momentum equal to 0.7. 
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3. Time series prediction 

The network is trained to predict the values of the signal at times (f+3), (t+4), (H-5), (£+6), 
(M-7) by using the values at time 0+2), (t+l), t. After the first prediction, these samples are used to 
feed the network's input in order to predict the future samples, recursively (iterative prediction) so 
that the forecasting horizon to be 5 steps ahead. Table 1 shows the performance of the proposed 
neural network scheme on the modelling of Chua's map for different values of hidden units for 
training set. 

The results of Chua's voltage prediction are shown in Figs 6 and 7. In particular, Fig.6 shows 
that for training set MSE is decreased as the number of hidden units is increased, while there is a 
significant difference in the quality of the models when the number of hidden units is chosen to be 
equal to the number of third order nearest neighbours. Similarly, Fig. 7 shows that for testing set 
NMSE is decreased as the number of hidden units is increased, while there is again a significant 
difference in the quality of the models when the number of hidden units is chosen to be equal to 
the number of third order nearest neighbours. The obtained results are shown in Fig. 8, where it can 
readily be seen that using as number of hidden units the number of near neighbours of order 3, we 
achieve multistep prediction with a five step forecasting horizon. 

Table 1 : Neural net performance 



Parameters 


Minimum 
Embedding 
Dimension 


Kolmogorov 
Theorem 


First 
order 

NN 


Second 
order 

NN 


Third 
order 

NN 


Fourth 
order 

NN 


No. of hidden 
units 


3 


7 


41 


119 


283 


683 


Training Set 
(MSE)xlO -3 


7.64 


7.23 


4.12 


1.80 


1.46 


1.42 


Testing Set 

(NMSE)xlO -3 

V(l) 


22 


34.4 


4.05 


5.49 


2.38 


2.77 


Testing Set 

(NMSE)xlO -3 
V(2) 


44.2 


38.7 


23 


11.9 


5.34 


4.14 


Testing Set 

(NMSE)xlO -3 
V(3) 


46.3 


48.6 


55.3 


12.5 


9.76 


8.74 


Testing Set 

(NMSE)xlO -3 

V(4) 


70.6 


88.5 


34.3 


20.1 


18.1 


16.9 


Testing Set 
(NMSE) xlO" 3 
V(5) 


90.1 


121 


70.2 


33.1 


27.6 


27.6 



Training Set Performance 
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Figure 6: Mean-square error of the Chua circuit's time series prediction for different values of hidden units 
(training set). 
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Figure 7: Normalized mean-square error of the Chua circuit's time series prediction for different values of 
hidden units (testing set) 
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Figure 8: Actual (crosses) and predicted (black line) values of Chua's chaotic signal. 



4. Conclusions 

It has been shown that focused time-lagged recurrent neural networks are capable to identify 
chaotic systems. However, when we deal with the observable results as obtained from some 
process, the mathematical formulation of which, as well as the total number of variables may not 
be known exactly, structure construction and adjustment of the artificial neural network remain an 
open problem. In this work, the chaotic analysis of the time series being modelled is used for the 
structure construction of a focused time-lagged recurrent neural network. In this respect, the 
number of hidden units is determined by the topological properties of the corresponding strange 
attractor. From the obtained results it is clear that the quality of prediction depends on the number 
of near neighbours that has been used as the number of hidden layer's neurons. According to the 
MSE of the training set as well as the NMSE of the testing set it has been found that the third order 
number of near neighbours give smaller error than the other parameters. 
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Abstract 

For Potts model on a Cayley tree we produce recursive relations that provide us 
the numerically exact phase diagram of the model. Each phase is characterized by a 
particular attractor and the phase diagram is obtained by following the evolution and 
detecting the qualitative changements of these attractors. These changements can be 
either continuous or abrupt, respectively characterizing second- or first- order phase 
transitions. We present a few typical attractors and at finite temperatures, several 
interesting features (evolution of reentrances, separation of the modulated region into 
few disconnected pieces, etc) are exhibited for typical values of parameters. 

Keywords: Potts model, recursive equations, attractor, phase diagram, phase transition. 



1 Introduction 

Consideration of spin models with multispin interactions has proved to be fruitful in many 
fields of physics, ranging from the determination of phase diagrams in metallic alloys and ex- 
hibition of new types of phase transition, to site percolation. The Potts model on the Cayley 
tree is one of these infinite dimensionality models that has received widespread attention by 
many authors recently since the appearance of the Vannimenus model [1],[2],[3],[5]. The Cay- 
ley tree, that is, an infinite connected tree whose sites have the same coordination number, 
has a thin structure without closed paths but with infinite dimensionality . By introducing 
competing interactions between Ising or Potts spin variables, assigned to each site, we en- 
able the system to present a very rich phase diagram with many modulated phases. The 
Vannimenus model, that is, the Ising model on a Cayley tree of coordination number p — 3, 
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with ferromagnetic nearest-neighbor interaction and with an antiferromagnetic next-nearest- 
neighbor interaction (then latter restricted to the sites belonging to the same branch) is the 
counterpart of the anisotropic next-nearest-neighbor Ising model (ANNNI) model defined on 
regular lattices. In the ANNNI model the competing interactions are restricted to a single 
direction, while in the Vannimenus model there is no preferential direction at all, that is, 
the competing interactions act between the ring generations in all directions. The phase 
diagram of the Vannimenus model shows in addition to the paramagnetic and the ferromag- 
netic phases a + H periodic antiphase < 2 > and a modulated phase, all of which meet 

at a multicritical point at zero temperature. From this result follows that the Ising model 
with competing interactions on a Cayley tree is real interest since it has many similarities 
with models on periodic lattices. This suggest that more complicated models should be 
studied on trees, with the hope to discover new phases or unusual types of behavior. This 
important point is that statistical mechanics on trees involve nonlinear recursion equations 
and are naturally connected to the rich world of dynamical systems, a world under intense 
investigation. 

In the present paper we have generalized for Potts model with competing binary in- 
teractions the approach used by Thompson [4] for the Ising model on the Cayley tree with 
only nearest-neighbor interactions and an external magnetic field. We were able to calculate 
exactly the partition function, the local magnetization, and the pair correlation function, by 
solving numerically a system of high-order coupled recursion equations for partial effective 
fields. The phase diagrams of our model can be obtained by studying the behavior of local 
magnetization and of the pair correlation function versus the generating number, and by 
looking at the fixed points of the coupled recursion relations for the partial effective fields. 
These diagrams have particularly distinct features depending on the range of competing 
parameters. 

2 The Potts Model and Effective Fields 

We consider a semi-infinte Cayley tree T+ = (V, L) of order 2, i.e., an infinite graph without 
cycles with 3 edges issuing from each vertex except for x° which has only 2 edges, where V is 
the set of vertices and L is the set of edges. Two vertices x and y are called nearest -neighbors 
if there exists an edge connecting them. The distance d(x, y) on the Cayley tree is the number 
of edges in the shortest path from x to y. For a fixed x° we set W n = {x e V : d(x, x°) = n} 
and V n = U™ =0 Wi. Two vertices x and y are called the second neighbors if d(x,y) = 2. The 
second neighbor vertices x and y are called one level second neighbors if x, y e W n for some 
n, and the second neighbor vertices x, y that are not one level are called prolonged second 
neighbors (see Fig.l). 
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Fig.l Three successive generations of a Cayley tree(solid line:nearest neighbor interac- 
tions; dot-dashed line: prolonged second neighbor interactions; dashed line: one-level second 
neighbor interactions). 

Let us consider a Potts model on a Cayley tree with competing nearest-neighbor inter- 
action Ji, prolonged and one level second neighbors interactions J2 and J3 respectively. For 
the three-state Potts model with spin values in {1,2,3}, the relevant Hamiltonian has the 
form 



H(a) = ~(3J 3 2_^ $a(x)a{y) ~ PJ2 2_^ $r(x)<r({/) — (Hi 2_^ $a{x)o 



(»)> 



(1) 



where a : V — > {1,2,3} is a configuration on V and (3 = ^ is the inverse temperature. 
Here first summation is over one-level second neighbors, second is over prolonged second 
neighbors, third is over nearest neighbors, Ji, J2, J3 G R and S is the Kronecker symbol. 
Below we produce recursive relations obtained following the lines of Inawashiro et al. Firstly 
we slightly modify Hamiltonian (1). Suppose the set of values of the spin variables a(x),x G 



V consists of vectors a,- G R 



1,2,3 such that |ctj| = 1 for all i with dot products 



G\Gi = o- 2 o- 3 = a 3 ai = —\. Since for all x,y G V 



-(a(x)a(y) + -) 



s. 



a{x)a(y)i 



the Hamiltonian (1) reduces to 



H(a) 



-J3 }_^ a ( x ) a (y) ~ J 2 2_^ v(x)a(y) - J l a(x)a(y), 



(2) 



where first summation is over one-level second neighbors, second is over prolonged second 
neighbors and last is over nearest neighbors. On the plane R 2 fix a basis ei,e2 , setting 
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ei = o"! and e 2 = a 2 . Since <7 3 = —0\ — a 2 , for any vector h = (hi, h 2 ) G R 2 we obviously 
have 

hen = h- h 2 /2, ha 2 = h 2 - h/2, ha 3 = -h x j2 - h 2 /2. (3) 

The iterative scheme can be set up by summing successively spins as can be seen in Fig.2. 




f 2 

Su 



Fig.2 Schematic diagram to illustrate the summation used in Eq.(4). 
Simple but tedious algebra gives 

J2 exp[ K lC r{x){o{A) + a{B)) + K 2 a(y)(a(A) + a{B)) + K 3 a(A)a(B) 

cr(A),a(B)e{ai,cr 2 ,cr 3 } 

+ X(a(A) + a(B))} =Cexp[Wa{x)a(y) + Ua(y) + Va(x)}, (4) 
where K % = J t /T(t = 1,2,3),X = (X U X 2 ),U = (U 1} U 2 ), V = (V 1} V 2 ), and 

2 w(l,l)w(2,l)w(3,l) 



U 2 = U 2 (X,K 1 ,K 2 ,K 3 ) 



In 
9 w(l,3)w(2,3)a;(3,3) 

2 w(l,2)w(2,2)a;(3,2) 

9 n w(l,3)o;(2,3)a;(3,3) 



v ' ' ' 3; 9 w(3,l)w(3,2)w(3,3) 
2 w(2,l)w(2,2)w(2,3) 



\/ 2 ==\/ 2 (X,ir i? K 2 ,^3 



In 
9 w(3, 1>(3, 2)w(3, 3) 



(5) 

(6) 

(7) 

(8) 
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W s W(X, K U K 2 , K 3) = I in (1 2W f / n ^^W^SWS ^ < 9 > 

9 oj{±, 2)u)(2, 10u;(l, 3)u;(3, l)cu(2, 3)u;(3, 2) 

C = C(A", K u K 2 , K 3 ) = [uj(1, l)w(l, 2)w(l, 3)w(2, l)w(2, 2)w(2, 3)w(3, l)w(3, 2)w(3, 3)] 1/9 

(10) 
with 



u(a, a') = e"°|a"lcr, a 



where 



*»[aW) + &W) + cW)l +2e-^3[_J_ + _L^ + _^_] (n) 

a (a, a J o(cr, a J c(a, o ') 

a(a, a 1 ) = exp^^cr + K 2 a x a' + X 1 - -X 2 ) (12) 

b(a, a') = exp(K l( T 2 a + K 2 a 2 a' + X 2 - -X x ) (13) 

c(a, a') = exp(K x a 3 a + K 2 a 3 a' - -X x - -X 2 ). (14) 

Beginning with X^ 1 ) = (0,0) and K\ — K\ = J\/T with J\ the initial nearest-neighbor 
coupling, we obtain from the above results the iteration scheme, for r = 2, 3, • • • ,N, 

X{ r) = 2U 1 (X^ 2 \ Kt 2 \ K 2 , K 3 ) + V 1 (X^ 1 \ Kt l \ K 2 , K 3 ) (15) 

I? = 2U 2 (X^~ 2 \ Kt 2 \ K 2 , K 3 ) + V 2 (X^\ Kt'K K 2 , K 3 ) (16) 

and 

K[ r) = K 1 + W(X^\ Kt'\ K 2 , K 3 ), (17) 

where I* ' = (0,0),k[ 0) = and K 2 = J 2 /T,K 3 = J 3 /T with J 2 , J 3 the initial prolonged 
and one-level second neighbors couplings respectively. Here vector X^ plays the role of 
an effective field, thus characterizing the rth shell mean magnetization. These recursion 
relations provide us the (numerically) exact phase diagram of the model. The equilibrium 
configuration for given values of T and J±, J 2 , J 3 is found by repeated iterations of recursion 
relations (15)-(17). The magnetization vector (X l7 X 2 ) flows to one of the following attrac- 
tors: (i) a trivial fixed point (X*,X%) = (0,0) (which corresponds to the paramagnetic 
phase); (ii) a nontrivial fixed point (Xf,X%) ^ (0,0) (the ferromagnetic phase); (Hi) a well 
defined periodic cycle (which corresponds to a commensurate phase with a given period); 
(iv) a one-dimensional orbit (associated with an incommonsurate phase); and (v) a strange 
attractor with a fractal character. Each phase is characterized by a particular attractor in 
the (X[ r) — X2 and (X{ — K{ ) spaces and the phase diagram is obtained by following the 
evolution and detecting the qualitative changements of these attractors. These changements 
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can be either continuous or abrupt, respectively, characterizing second- or first-order phase 
transitions. Let us introduce a = T/Ji,b = —J2/J1 and c = J3/J1. Below we consider a 
strange attractors in the planes (X\ — X2) and (X\ — K\) for selected values of a, b and c. A 
few typical strange attractors are presented in Figs. 3-6. 
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Fig. 3. Examples of attractors in the X\ — X2 and X\ — K\ spaces with c = 0. 
Interesting feature is that fact that, for second case the modulated phase appears in two 
disconnected pieces. 
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(ii)a= 1.0; 6 = 1.2 

Fig.4. Examples of attractors in the X\ — X2 and X\ — K\ spaces with c = ±0.001. 
Here for small c appear both commensurate and modulated phase with two disconnected 
pieces. 
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Fig.5. Examples of attractors in the X\ — X2 and Xi — K\ spaces with c = 1. 
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Fig.6. Examples of attractors in the Xi — X 2 and Xi — K\ spaces with c = — 1. 
Attractors in last two figures correspond general modulated phases. 

3 Conclusions 

The numerical investigations of the mapping established the existence of a complete devil's 
staircase at low temperatures, and the appearance of chaotic phases, in the core of the tree, 
for a given set of boundary conditions. The study of additional aspects of this and related 
models is planned to be the subject of forthcoming publications. 
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Abstract 

The Rhesus system is the second most significant blood group system in human 
blood transfusion. Individuals either have, or do not have, the Rhesus factor(or Rh 
D antigen) on the surface of their red blood cells. A child inherits two rhesus genes, 
one from each parent, where gene D correspond to positive rhesus factor and gene d 
correspond to negative rhesus factor. The transmission of rhesus from parents to their 
offspring are random and events that contradict Mendel laws increase this randomness. 
To study this transmission we apply theory of quadratic stochastic operators and show 
that corresponding genetic algebra is non-associative. 

Keywords: Rhesus factor; quadratic stochastis operator; genetic algebra; divisible algebra. 



1 Introduction 

The theories of heredity attributed to Gregor Mendel (1822-1884), were based on his work 
with pea plants. The short monograph, Experiments with Plant Hybrids, in which Mendel 
described how traits were inherited, has become one of the most enduring and influential 
publications in the history of science. He saw that the traits were inherited in certain 
numerical ratios. From his studies, Mendel derived certain basic laws of heredity; hereditary 
factors do not combine, but are passed intact; each member of the parental generation 
transmits only half of its hereditary factors to each offspring; and different offspring of 
the same parents receive different sets of hereditary factors. Mendel's work became the 
foundation for modern genetics. 

Mendel, in his first paper exploited some symbolism, which is quite algebraically sug- 
gestive, to express his genetic laws. In fact, it was later termed "Mendelian algebras" by 
several authors. General genetic algebras indeed are the product of interaction between 
biology and mathematics. The study of these algebras reveals the algebraic structure of 
Mendelian genetics, which always simplifies and shortens the way to understand the genetic 
and evolutionary phenomena in the real world. 

Before we discuss the genetic from a mathematical perspective, it is useful to know some 
of the basic language from biology. A gene is a unit of hereditary information. The genetic 
code of an organism is carried on chromosomes. In addition, each gene on a chromosome can 
take different forms that are called alleles. For example, the gene that determines Rhesus 
system in humans has two different alleles, that are D and d. Recall that the Rhesus system 
is the second most significant blood group system in human blood transfusion. Individuals 
either have, or do not have, the Rhesus factor (or RhD antigen) on the surface of their red 
blood cells. This is usually indicated by Rh + (does have the RhD antigen) or Rh~ (does not 
have the antigen) suffix to the ABO blood type. Rhesus factor for human are determined by 
two alleles since humans are diploid organisms, a child inherits two rhesus genes, one from 
each parent, where gene D correspond to positive rhesus factor and gene d correspond to 
negative rhesus factor. Offspring is rhesus negative if they have inherited a gene d from each 
parent (d, d) and offspring is rhesus positive if they inherited a D gene from both parents. If 
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offspring have inherited a rhesus positive gene D and a rhesus negative gene d, they are most 
likely to be rhesus positive as the D gene is more dominant as compared to the d gene. Hence 
it is possible to have a rhesus negative child and a rhesus positive father. Thus rhesus of 
parents do not determine unambiguously their offspring's rhesus. The transmission of rhesus 
from parents to their offspring are random and events that contradict Mendel laws increase 
this randomness. To study this transmission we apply quadratic stochastic operators. 

2 Quadratic Stochastic Operator 

Quadratic stochastic operator was first introduced in [l].Such operator frequently arises in 
many models of mathematical genetics [1], [2], [3]. Consider a biological population, that is 
a community of organisms closed with respect to reproduction. Assume that each individual 
in this population belongs to precisely one species 1,2, •• • , m. The scale of species is such 
that the species of the parents % and j unambiguously determines the probability of every 
species k for the first generation of direct descendants. We denote this probabilitythat is to 
be called the heredity coefficient, by Pi^k- It is then obvious that pij y k > for all i,j,k and 
that 

m 

^Pij,k = l,(i,j,k = l,-- ,m). (1) 

fc=i 

Assume that the population is so large that frequency fluctuations can be neglected. Then 
the state of the population can be described by the tuple (x±,X2, ■ ■ ■ , x m ) of species probabil- 
ities,that is Xk is the fraction of the species k in the total population. In the case of panmixia 
(random interbreeding) the parent pairs % and j arise for a fixed state x = (x\,X2, • • • ,x m ) 
with probability XiXj. Hence 

m 

x 'k = Yl Pii^XiXj, (k = 1, • • • , to), (2) 

is the total probability of the species k in the first generation of direct descendants. 
Let 

m 

S™- 1 = {x = (xi, • • • ,x m ) e R m : x t > 0, Y,^ = 1} (3) 

i=i 

is the (to — 1) -dimensional simplex in R m . The transformation V : S m ~ 1 — > S m ~ l is called 
a quadratic stochastic operator(q.s.o.) if 

m 

V : (V r x) fe = y^ Pij,kXjXj, (k = 1, ••• ,to), (4) 

where 

m 

a)Pij,k > 0; b)p ijtk = Pji,k] and c) ^Pij, k = 1 

fe=i 

for arbitrary i,j,k— 1, • • • , to. Note that the condition p^^ = Pji,k is n ot overloaded, since 
otherwise one can determine new heredity coefficient 

Pij,k ~r Pji,k 

Qij,k — ^ 
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with preserving operator V. 

We shall call a quadratic stochastic operator V a genetic realization of some model of 
heredity. 



3 Algebra with genetic realization 

Mathematically, the algebras that arise in genetics are very interesting structures. Many of 
the algebraic properties of these structures have genetic significance. Indeed, the interplay 
between the purely mathematical structure and the corresponding genetic properties makes 
this subject so fascinating. 

The most general definition of an algebra R which could have genetic significance is that 
of algebra with genetic realization. 

Let a quadratic stochastic operator V : S n ^ 1 — > S 11 ^ 1 be a genetic realization, where V 
is defined by cubic matrix {pij, k '■ h j, k = 1, • • • , n) such that 

rn 



a)Pij,k > 0; b)p ijjk = p ji>k ; and c) \ p ijtk = 1. 



fe=i 

An algebra K. with genetic realization V is an algebra over the real numbers R which has a 
basis {oi, • • • , a n } and a multiplication table 

n 

a i a j = / Pij,kO>k- 
k=\ 

Here pi k j is a frequency that the next generation reproduced by two gametes carrying a* 
and cij will inherit a k ,k = 1, 2, • • • , n. 

Below we will consider case n = 2 and let a± = A, a,2 = a. Then a general element 
aA + j3a of genetic algebra which satisfies a, [3 G R with < a,[3 < 1 and a + j3 = 1 can 
represent a population or a single individual of a population. In each case, the coefficients 
a and (3 signify the percentage of frequency of the associated allele. I.e., if the element 
represents a population, then a is the percentage of the population which carries the allele 
A on the gene under consideration. Likewise, f3 is the percentage of the population which 
has the allele a. 

For those elements of the genetic algebra which represent populations, multiplication of 
two such elements represents random mating between the two populations. In general, the 
algebras which arise in genetics are commutative but non-associative. In [5] proved following 
Theorem. 

Theorem 1 The two-dimensional algebra with the standard basis {A, a} and with 
genetic realization 

PAA,A = Z, P Aa ,A = V, Paa,A = X 

and 

R AA,a = 1 — Z, RAa,a = 1 — Vi Raa,a = 1 — iC, 

is associative algebra if and only if the coefficients x, y, z satisfy the following equation 

xz + y — y 2 — x = (5) 

It is proved that arbitrary x G [0, 1], y G [x — x 2 , l],and z = x ~ x+y satisfy equation (5) with 
< x,y, z < 1. 
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4 Division Algebra 

An algebra R is called a division algebra if for any element / in R and any non-zero element 
g in R there exists precisely one element h in R with f — gh and precisely one element d in 
R such that / = dg. For associative algebras, the definition can be simplified as follows: an 
associative algebra R over a field R is a division algebra iff it has a multiplicative identity 
element e^ and every non-zero element / has a multiplicative inverse, i.e. an element h 
with fh — hf — e. We show that two-dimensional associative genetic algebra R considered 
above is not the division algebra and describe non-invertible elements. It is easy to show 
that the element 

y a x 

e = A H a 

y — x x — y 

is the multiplicative identity of R. For arbitrary element / = 7 A + 5a in R the element 

y[l{y ~xy + y 2 ) + 5(y + xy - y 2 )} 

(y ~ x) 2 (l + S) [7(1 -x)- 5y] 
r yx{x — 2y + Ixy — x 2 — y 2 ) — 5y(2y 2 — 3xy + x 2 — y)] 
(y - x) 2 {j + 5) [7(1 - x) - 5y] 

is a multiplicative inverse of / if 7 + 5 7^ and 7(1 — x) — 5y 7^ 0. Let 

R_ 1 = {f = 1 A + 5a: 1 + 5 = 0} (6) 

li^ = {f = 1 A + 5a: 7(1 -x) -5y = 0}. (7) 



y 



Thus / = '-/A + 5a G B1-1 is not invertible population if < 7, 5 < 1 with 7 + <5 = 1, 

y 

i.e., for given x,y,z that satisfy (5), exist unique non-invertible population. 

5 Genetic Algebra Generated by Transmission of Fac- 
tor Rhesus 

To describe the transmission of factor rhesus from parents to their offspring we need to 
find the probability Pxy,z that from a father with factor rhesus X and a mother with factor 
rhesus Y their child receives factor rhesus Z, with X,Y, Z e {1,2}, where for brevity 1 denote 
positive rhesus and 2 denote negative rhesus. Let N(Fx,My) be the number of offspring 
of fathers with rhesus factor 4X4 and mothers with rhesus factorF and N z (Fx, My) be the 

number of offspring with factor rhesus Z. Then the transmission probability Pxy,z is defined 

as 

N Z (F X ,M Y ) 

PxY ' Z ~ N(F x ,My)- (8) 

For collected data according (8) we have following: 

Pn,i = 0.985, Pi 2) i = 0.647, P 2 i,i = 0.657, P 22 ,i = 0.092. 

One can see that the condition b) in (3) is broken. Let consider new heredity coefficients 

*ij,k T -iji,k 
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where 

q u ,i = 0.985,gi 2i i = 0.652, 922,1 = 0.092. 

Then 

2 = 0.985,y = 0.652,a; = 0.092 

that do not satisfy equation (5). Thus the genetic algebra generated by quadratic stochastic 
operator of rhesus factor transmission is non-associative algebra. 
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Abstract 

A sample of sixty one two dimensional radiographic images of the lateral pillar 
of the femoral head were subjected to fractal analysis in order to investigate its 
ability to discriminate two groups of images - femoral heads with Legg-Calve- 
Perthes disease and normal femoral heads. Skeletonized images of the femoral 
head contours were successfully quantified by the box counting method, showing 
significant difference in contours of the affected femoral heads than those of 
normal femoral heads. Further investigation in application of the fractal analysis 
to the current classification scheme of radiographs of the affected femoral heads 
is also discussed. 
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1. INTRODUCTION 

Joint cartilage is in close contact with the underlying subchondral bone. 
Both the joint cartilage and the subchondral bone take part in transmission of the 
force in the craniocaudal direction and adjust themselves to mechanical load to 
the extent necessary to prevent any damage to their structure. The cause of Legg- 
Calve-Perthes (LCP) disease has not been clearly defined yet, so that the very 
onset of the disease - infarct of the subchodral bone, remains unknown. For that 
reason, there is a wide span of accepted clinical and radiographic presentations 
of Legg-Calve -Perthes disease [1,2]. It covers the cases from the minimum or no 
change in the contour of the femoral head to its massive destruction. As the 
disease develops in four stages (infarction, resorption, revascularization and 
remodeling), it is desirable that it is diagnosed and treated as early as possible 
[3]. Younger children have far better chances for a successful final outcome, but 
it depends on the stage of the disease at the moment of its identification and the 
beginning of the treatment [4]. 

Modern radiographic classification to assess the severity of LCP disease 
began with Catterall (1982), who defined 4 types of the disease, the first two 
associated with a good while the third and the forth type are associated with a 
poorer prognosis [1]. Salter and Thomson (1984) classified the severity of the 
disease on the basis of the extent and location of the subchondral fracture that 
appears early in the course of the disease [5]. The most recent radiographic 
classification is also classified into four groups but based on the degree of lateral 
pillar damage [6], 

The aim of this study was to check the possibility of application of the 
fractal analysis to the radiographic image of the lateral pillar of normal femoral 
head and to the same image showing synovial fluid secretion in patients 
suspected of having LCP disease. Also, the study investigates the use of fractal 
dimension as a parameter, which quantifies the contour of the femoral head in 
patients with LCP disease and discriminates this group of patients from patients 
with normal femoral heads. 



2. MATERIALS AND METHODS 

2.1. Image acquisition 

A sample of sixty one 2D radiographic images of hips, taken from children 
from 7 to 11 years, was used in this study. The group of thirty one images 
belonged to children with diagnosed LCP disease. Radiographic images were 
analyzed according to modified lateral pillar classification GBK [6], when 
changes in femoral heads have been confirmed. Thirty images, with no changes 
in femoral heads, were used as controls. 
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Radiographic images were digitized using a digital camera (Olympus 560 
UZ, Japan) at a maximal camera resolution (8 MPix), imported into a PC 
computer and processed further by Image J software (NIH Image, 
www.rsb.info.nih.gov/ij/). Using the Image J program tools, a rectangular region 
of interest was selected from the digitalized femoral head image within the 
lateral pillar (Fig. l.A, white rectangle), and saved as a new file in grayscale 
format (Fig. l.B). 





A B 

Figure 1. A) Radiographic image of the femoral head with region of interest 
(white rectangle) used for further analysis. B) Zoomed in region of interest of the 
femoral head within the lateral pillar. 





A B 

Figure 2. Image of the studied region of the femoral head with drawn contour 
(A) and a binary image of the femoral head contour (B). 

Then, a line along the boundary of the selected lateral pillar region, from the 
lateral edge of the lateral pillar to the lateral aspect of the medial pillar of the 
head epiphysis, was drawn (Fig. 2. A). In the next step, all unnecessary points 
from the digitized image above and below the head contour were digitally 
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removed (Fig. 2.B). The obtained grayscale image contour of the head was 
converted to a binary image, skeletonized to a one pixel thick line and subjected 
to the fractal analysis. 

2.2. Image analysis 

Skeletonized images of the femoral head contours were examined 
quantitatively by fractal analysis, using its best-known technique, the box 
counting method [7,8]. The method is based on covering the object image with 
sets of square boxes of known box side size and on counting the boxes covering 
(or contiguous to) the image. The number of boxes covering the image increases 
with decreasing box size, with a correlation between the number of boxes N and 
the box side length r described by 



N(r) = Br D 



(1) 



where B is a constant and D is the fractal dimension. Taking the logarithm of the 
left and right side of Eq. (1), the equation of a straight line is obtained 



log N(r) = -D ■ log r + log B . 



(2) 



The fractal dimension of the analyzed object is calculated by Eq. (2), as a 
positive value of the slope of the straight line plotted using the least squares 
method. 



D)2 
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D = 1 .064 
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R = 0.997 
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Logr 




Figure 3. Log-log relationship between the number of boxes (N) and the box side 
length (r) of the control (A) and the patient group (B). Values of the fractal 
dimension D and the correlation coefficient R of the fitted straight lines are given 
on the graph (bottom left). 



63 



MILOSEVIC, MARIC: FRACTAL ANALYSIS 



Box counting was performed using the Fractal Box Count program 
implemented in Image J. A series of measurements of the total number of boxes 
for box side length from 2 1 to 2 k pixels was made, where k is the number for 
which the number of boxes is equal to one, i.e. when one box covers the whole 
image. Figure 3 shows the log of the number of boxes plotted against the log of 
the box side length for two skeletonized images of the femoral head contour of 
the control (Fig. 3. A) and the patient group (Fig. 3.B). The correlation coefficient 
(R) for both straight lines (Fig. 3), obtained by fitted sets of ten points, is 
statistically different from zero (p < 0.001), indicating linear dependence of the 
number of boxes on box side length over two or more decades. 

2.3. Statistics 

Statistical analysis of the calculated fractal dimension of the skeletonized 
images depends on whether the fractal dimension distribution is normal or not. In 
the case when the calculated fractal dimension follows a normal distribution, 
each group is described by the corresponding mean value and standard deviation 
(or standard error). Further analysis is performed according to the methods and 
tests of parametric statistics. Alternatively, when the calculated values do not 
follow a normal distribution, the groups are described by the medians, and value 
range, and further analysis proceeds according to non-parametric statistics laws. 

It is known that the testing whether the data is distributed normally is 
performed by a chi-square test if the studied population consists of a large 
number of samples (more than 50). If the sample is small then testing of the 
distribution character is based on the calculation of two statistical parameters: 
skewness and excess of distribution. The interval of skewness and excess values, 
which define the normal distribution, is estimated when these two parameter are 
divided by the corresponding mean square errors (o 3 and o 4 ). If the absolute 
value of the quotients 03/03 and 04/04 is less than or equal to 2, then the data 
distribution is normal. Otherwise, the distribution in a sample (or population) has 
no characteristics of a normal distribution. For further explanation of this 
procedure, the reader is referred to [8]. 



3. RESULTS 

Table 1 shows the values of the parameters used to assess the nature of the 
distribution of the fractal dimension of femoral head contours of the control and 
patient group. Also, the values of quotients \a^/aj\ and |e/o 4 | are given. As the 
values of these quotients do not exceed the critical value, i.e., 2, it means that the 
fractal dimension values for both groups are normally distributed. Therefore 
further statistical analysis of the fractal dimensions was performed according to 
the parametric statistics laws. 
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Table 1 . The values of the third (m 3 ) and the forth moment (ma), skewness (a 3 ), 
excess (e), and the mean square errors (cr 3 and <7 4 ) in distribution of fractal 
dimensions of femoral head contours of the control and patient group. 



Parameters 


Control 


Patients 


m 3 


5.62- 10" 6 


1.27-10" 5 


m 4 


3.29-10" 6 


4.01 TO" 5 


a 3 


0.15 


0.05 


e 


-0.40 


-0.28 


cr 3 


0.41 


0.41 


cr 4 


0.74 


0.74 


|fl 3 /cr 3 | 


0.37 


0.13 


\e/a 4 \ 


0.53 


0.37 



Table 2. The values of the parameters used in statistical analysis of fractal 
dimensions of femoral head contours of the reference and patient group. Symbol 
p represents the level of confidence. 



Fractal dimension 


Control 


Patients 


Range 


1.004-1.131 


1.021-1.262 


Mean value 


1.058 


1.121*** 


Standard deviation 


0.034 


0.062 


Standard error 


0.006 


0.011 


Sample size 


30 


31 



***-/?< 0.001 

The results of calculated mean values of fractal dimensions of the femoral 
head contours, standard deviations and standard errors for the control and the 
patient group, as well as the statistical analysis of the obtained values are 
presented in Tab. 2. It can be seen from Tab. 2 that the intervals of the calculated 
fractal dimensions of the control and the patient group partially overlap. The 
mean values of fractal dimensions are different; the mean value of the fractal 
dimensions of the patient group is higher than that of the control group. The t- 
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test applied to the mean values of the fractal dimensions revealed a statistically 
significant difference of a high confidence level (p < 0.001). 



4. DISCUSSION 

Fractal analysis is a set of mathematical techniques used to quantify 
complex structures. Namely, the fractal dimension of a structure expresses 
numerically the degree of geometrical complexity of that structure [7]. 
Quantitative analysis of the bone structure can be successfully made by applying 
the concept of fractal geometry, as the bone is known to have a complex and 
irregular structure. In past years, the fractal analysis of radiographic images of 
bones was applied to study the structure of normal bone [9], as well as that 
affected by osteoporosis [10-13] and osteoarthritis [14]. To the best of our 
knowledge, fractal analysis of the bone contour has not attracted researchers' 
attention, contrary to other scientific fields where the fractal analysis of the 
object's contour has been studied extensively [7,15,16]. 

In this study, using fractal analysis we examined the contour of the lateral 
pillar of the femoral bone in healthy children and children with diagnosed LCP 
disease. The fractal dimension of femoral head contours in children with LCP 
disease are higher than the fractal dimension of the contours in healthy children, 
which indicates that the contours of the affected femoral heads are more complex 
and irregular in shape than those of normal femoral heads. This result 
quantitatively confirms that the degree of damage to the femoral head affected by 
LCP disease can clearly be defined and quantified by fractal analysis. Having 
objective quantitative results allows for a stratification of treatment that best suits 
the stage of disease progression. 

This study can be considered as a good start in further investigation of the 
quantification of macroradiographic images in patients with developed LCP 
disease. These images are classified with respect to the degree of damage of the 
femoral head, it would be interesting to test whether the fractal dimension can 
discriminate between the existing categories of disease. We believe that such 
analysis of macroradiographic images can lead to a more reliable interpretation 
of the stages of the disease in interobserver trials. 
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The impedance method is applied for the identification of Hopf instability 
in a model electrochemical system with N-shaped voltammetric curve. The 
system displays a threshold response. At low and medium values of bifurcation 
parameter (the preceding chemical reaction rate) the system can have two and 
one Hopf bifurcation point, respectively, whereas at high values of this 
parameter the system remains stable to Hopf instability. 

Keywords: Hopf bifurcation, Negative differential resistance (NDR), N-shaped 
current-potential curve, Impedance spectroscopy, Kinetics. 

1. INTRODUCTION 

Electrochemical systems are complex dynamical systems [1-15]. The 
frequent appearance of oscillations and pattern formation in electrochemistry can 
be explained by the inherently nonlinear electrochemical kinetics and far from 
equilibrium performance of electrochemical experiments. Based on the 
principles of nonlinear dynamics and characteristics of electrochemical systems, 
there are mainly two types of electrochemical oscillators: N-shaped current - 
potential (N-NDR) and S-shaped current - potential (S-NDR) characteristics [6, 
7, 14]. In both cases voltammetric curve has a potential region with a negative 
slope (NDR). Most of the electrochemical oscillators (for example, 
electrodissolution of metals, electrocatalytic oxidation of small organic 
molecules such as formaldehyde, formic acid, methanol and hydrogen oxidation) 
belong to N-NDR type. In S-NDR systems (for example, electrodeposition of 
Zn, CO electrooxidation on Pt) electrochemical Turing structures can be 
observed. 

Electrochemical impedance spectroscopy (EIS) is an effective method for 
analyzing the dynamical properties of electrochemical processes over a large 
range of frequencies [1, 8]. In this method, a small amplitude electric modulation 
(either of potential or current) is applied near a stationary reference state and the 
linear response of the system is measured over a wide frequency range. As is 
known this method is useful for the identification of Hopf instability in the 
electrochemical systems, which is hard to realize by other methods [5]. 
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In the paper, we focus on the detection of Hopf instability in a model 
system with electrocatalytic mechanism [5] on a flat electrode and a preceding 
homogeneous chemical reaction in bulk solution under potentiostatic conditions. 

2. MODEL 

The model process can be schematically written as 

k 1 k a x 

^bulk < ~ A bulk ~» A surf < ~ A ads s — >P + <?, (1) 

k 2 k d 

where k\, &2 are the rate constants of chemical reaction in the bulk solution, and 
k a , kd, K e are the rate constants of adsorption, desorption, and electron transfer, 
respectively. The last step of the reaction is considered to be irreversible. 

The electroactive species of one sort, which are produced by preceding 
chemical reaction, diffuse from the diffusion layer to the flat electrode surface, 
where they are adsorbed and electrochemically oxidized. Neglecting the Ohmic 
losses and double layer influence, we can write the rates of adsorption- 
desorption and electron transfer as follows: 

v l (t) = Tk a exp(y9(t) 1 2) c(0, t) (1 - 9{t)) - Tk d exp(-y9(t ) / 2) 9(t) , (2) 

v 2 (t) = TK e (t) 9(t) = Tk e exp(«/E(f )) 9(t) . (3) 

Here, c(Q,f) is concentration of electroactive species at the electrode surface, 9(f) 
is the coverage of the electrode surface with the adsorbate, y is an interaction 
parameter (the attraction constant), T is the maximum surface concentration, F is 
the Faraday's number, R is the gas constant, T is the absolute temperature, a is 
the symmetry factor of electron transfer in the direction of oxidation, E is the 
electrode potential, / = F I RT . According to Eq. (2) the adsorption-desorption 

of species A on the electrode surface under steady-state conditions is described 
by the Frumkin isotherm. 

The changes in the electrode surface coverage 9 with adsorbate and in the 
concentration c(x,t) = c +u (u is a deviation of concentration from equilibrium 
concentration c ) satisfy the following equations: 

r— = v l (t)-v 2 (t), (4) 

at 

8u d 2 u 

— = D — --ku (5) 

dt dx 2 

with boundary conditions 

J c ( X = 0, f) = -D 9u( - X ' f) I x=0 = -v x it) , u(d,t) = 0, (6) 

dx 

where k is the effective rate of preceding homogeneous chemical reaction, D is 
the diffusion coefficient, d is the Nernst diffusion layer thickness. The origin of 
coordinates coincides with the electrode plane. 

The faradaic current density is determined by the following equation: 

i f (t) = Fv 2 (t) = FTk e exp[a/E(f )]9(t ) . (7) 
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2.1. Steady-State Conditions 

The solution of the diffusion equation under steady-state conditions yields 
the following expressions for the steady-state electrode potential E s and the 
steady-state concentration at the electrode surface c st (x = 0) 

E s = { af T ^ r^l- C f\ (8) 

(Q)= m c c o + rk d s G o e-^ (9) 

where m c =D/d, G =thJr d k / Jr d k , r d =d ID (r d is diffusion time of 

relaxation). 

The steady-state faradaic current density is given as: 

i fs =Fm c (c -c st (0)). (10) 

To study the linear stability of a nonlinear system near its steady state, a 
well-known procedure is usually used, which consists in finding Jacobian matrix 
eigenvalues for equations of state. Recently it was shown that for an 
electrochemical system its complex impedance zeros are the eigenvalues of 
Jacobian under potentiostatic control (fixed applied potential) [9]. The sign of 
the real part of impedance zero indicates the stability region of the stationary 
state. As was shown, a Hopf bifurcation can realize when complex impedance of 
electrochemical system is equal to zero at nonzero frequency, Z(&>) = at co = co H 
■*■ (a> = 2nf, f - frequency) [2, 5, 6, 13]. At Hopf bifurcation the system 
produces its own undammed periodic oscillations with frequency co H , so in the 
case of influence on the system of an external signal with a frequency exactly 
coinciding with this value, the external signal will pass through the system 
without resistance . 

In our calculations we neglected the electrolyte resistance and did not take 
into account the double layer impedance. In this case, the impedance of the 
considered model system is equal to the faradaic impedance. 

2.2. Hopf bifurcation and impedance spectra 

To calculate the faradaic impedance of this system we consider its dynamic 
behavior when a low periodical signal is applied to the steady-state polarization 
potential 

E(t) = E s +AE e jcot , (11) 

where j = >/-[ . 

In response to this excitation the electrode surface coverage 0{t) oscillates 

near steady-state value as the faradaic current i f (?) and concentration c(x, t) do. 

0(t ) = e s + A^e-^ , i f (t) = i fs + M f (E,0), c(0, t) = c st (0) + Ac(0, 0) . (12) 
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The faradaic impedance in the Laplace image space F(s) = \ f(t)e~ s dt is 

o 
expressed as a function of complex frequency: 

Z(s)= - / • (13) 

Ai f (s) 

Omitting some mathematical computations the resultant expression for the 
faradaic impedance in the Laplace space can be written as: 

Z(s,k) = R rt {\ + e -^ c ' V n }, (14) 

Ts\V+d c v x G(k,sj\-d e v x 

where 

R rt =— — = (charge transfer resistance), (15) 

dij^ FTafk e exp(afE s W s 

dE s 

1 th Jx d (k + s) 

G(k, s) = v — (finite length Gerischer impedance), (16) 

m c JT d (k + s) 

dgvi =T{k d exp(-^ I2)[y6 s l2-l] + k a exp(^ /2)c,(0)[Kl-^)/2-l]}, (17) 

d c v x = Tk a (l-0 s )exp(r0 s /2) , (18) 

d 9 v 2 = Tk e exp(afE s ) , (19) 

<3 £ v 2 = afTk e exp(afE s[ )0 S . (20) 

For the sake of convenience, the partial derivatives are designated here as 
d x u -dul dx . 

Thus, to find the Hopf bifurcation points of the system, the zeros of 
impedance Zt (s) depending on electrode potential must be studied. 

In our case, the impedance zeroes can be found from the following 
equation: 

rs[l + d c v 1 G(k,s)]-d v 1 +d v 2 [l + d c v 1 G(k,s)]=O. (21) 

This is the equality to zero of the numerator of Eq. (14). 
Eq. (21) can be presented as 

x ¥(s,8,k) = 0. (22) 

To satisfy the condition (22), it is necessary that 

\ (23) 

[im[^(s,0,k)]=O 

Eq. (23) can be solved only numerically. 

In order to pass from the Laplace space to the Fourier space, it is necessary 
to perform a substitution s = jco . 

In the model calculations, the following values of the system parameters 
were taken: 
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10" 9 mol cm- 2 ; 



Y= 



Fk. d = 0.1 cm s" ; Tk d ■■ 



10 5 mol /cm 2 s; 



L=10 s - 



D = 10~ 5 cm 2 /s; d = 10 3 cm; a = 0.5; c = 10~ 5 mol/cm 3 ; F = 96484C/mol; 
R = 8,314 J /mol K; T= 295 K; / = F I RT =38,7 V" 1 . 

Numerical calculations were performed on the basis of the Matematica 6 
mathematical package. 

3. RESULTS AND DISCUSSION 

The steady-state curves i fs vs. E, of model process are N-shaped with a 
region of negative differential resistance (NDR) in which the Hopf instability 
occurs. 

Fig. 1 shows the surfaces of zeros of functions Re[ v F(5, 0, k)] and 

ImfT^, 0, k)] . The line of their intersection is the solution of Eq. (23). It 

consists of the Hopf bifurcation points, i.e. the bifurcation values of frequency, 
coverage of electrode with adsorbate and preceding chemical reaction rate. 



600. 



300 



200 



100 




Fig. 1. Surfaces Re[ x ¥(s,d,k)] = and lm[ y ¥(s,0,k)] = O. 



As is seen from Fig. 1, there are two types of dynamical behavior of the 
electrochemical system depending on the reaction rate as a bifurcation 
parameter. At low and medium values of k (k < 133 s" 1 ) the system has two 
Hopf bifurcation points, where the real and imaginary parts of faradaic 
impedance are equal to zero at nonzero angular frequency. The mentioned 
critical value of k and bifurcation values of frequency and coverage can be 
observed in Fig. 2 presenting the cuts of surfaces of impedance zeros. At the 

value k th =133 s~ one can find only one bifurcation point where spontaneous 
oscillations can set up. For the values of k higher than this threshold value k th 
the system remains stable to Hopf bifurcation, and oscillations are absent. 
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Fig. 2. Cuts of surfaces Re[¥(>, 9, k)] = (bold line) and Imt^O, 0, k)] = 
(dashed line) at fixed values of k . 

Table 1 shows the bifurcation values of electrochemical parameters for the 
reaction rates k from the described above regions. 

Table 1. Values of electrochemical system parameters 
at Hopf bifurcation points 



k, s" 1 


Point # 


On, Hz 


0r 


ip, A cm" 2 


E„,V 


0.5 


1 


135.44 


0.570 


0.0081 


0.139 


2 


182.39 


0.190 


0.0044 


0.166 


75 


3 


286.39 


0.420 


0.0066 


0.197 


4 


313.34 


0.243 


0.0046 


0.206 


133 


5 


329.01 


0.320 


0.0053 


0.214 
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Fig. 3 presents Nyquist faradaic impedance diagrams in the complex plane 
at bifurcation points 1, 3 and 5. Here one can see a decrease of the inductive 
loop, where the faradaic-impedance real part is negative, with an increase of k . 
The negative faradaic-impedance real part determines the instability existence in 
the system. For a> — > oo , Z t (cd) - R cr , all curves converge in one point. 

-Im[Z((j);R.:i 



Rf ;Zlu! ~B.:i 




Fig. 3. Nyquist impedance diagrams at Hopf bifurcation points (see text) for: 
A: = 0.5 - dotdashed line; k = 75 - dashed line; A: = 133 - bold line. 



An increase of k leads to a decrease of the impedance modulus. It turns to 
zero at a> = <% (Fig. 4). An increase of k shifts the bifurcation frequency to the 
region of higher values. The functional dependence of the impedance phase 
angle on the frequency a is changed in the Hopf bifurcation point. 

Abs[Z(t;)/Ra] pig. 4. Impedance modulus at 

Hopf bifurcation points (see text) 

for: k = 0.5 - dotdashed line; 

k = 15 - dashed line; k = 133 - 

bold line. 
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4. CONCLUSION 

On the basis of the theory of electrochemical impedance spectroscopy an 
effort was made to determine the origin of Hopf instability in a model system 
with a preceding homogeneous chemical reaction occurring in the bulk solution 
and a charge transfer reaction followed the potential -dependent adsorption- 
desorption process on a flat electrode. It was shown that the stability of the 
system can be influenced by the rate of such chemical reaction. The obtained 
results indicated the possibility of the instability control. 



74 



Predicting The Onset of Spontaneous Oscillations Using Impedance Method 



REFERENCES 

1. E. Barsoukov and J.R. Macdonald, Impedance Spectroscopy: Theory, 
Experiment, and Applications (2nd ed.), Wiley Interscience, New York, 
2005. 

2. F. Berthier, J. -P. Diard and C. Montella, Hopf bifurcation and sign of the 
transfer resistance, Electrochim. Acta, AA, 2397-2404 (1999). 

3. A. Bonnefont, R. Morschl, P. Bauer, K. Krischer, Electrochemical 
impedance spectroscopy of patterned steady states on electrode surfaces, 
Electrochim. Acta, 55, 410-415 (2009). 

4. J. Christoph and M. Eiswirth, Theory of electrochemical formation, Chaos, 
12,215-230(2002). 

5. M.T.M. Koper, Stability study and categorization of electrochemical 
oscillations by impedance spectroscopy, J. Electroanal. Chem., 409, 175- 
182(1996). 

6. M.T.M. Koper, Non-linear phenomena in electrochemical systems, J. 
Chem. Soc. Faraday Trans., 94, 1369-1378 (1998). 

7. K. Krischer, Principles of temporal and spatial pattern formation in 
electrochemical systems, in Modern Aspects of Electrochemistry (B.E. 
Conway, J.O.M. Bockris and R.E. White, eds.), vol. 32, Kluwer 
Academic/Plenum Publishers, New York 1999, pp. 1-142. 

8. A. Lasia, Electrochemical impedance spectroscopy and its application, in 
Modern Aspects of Electrochemistry (B. E. Conway, J. O. M. Bockris and 
R. E. White, eds.), vol. 32, Kluwer Academic/Plenum Publishers, New 
York 1999, pp. 143-248. 

9. M. Naito, N. Tanaka, H. Okamoto, General relation between complex 
impedance and linear stability in electrochemical systems, J. Chem. Phys., 
111,9908-9917(1999). 

10. R. Jurczakowski, M. Orlik, Experimental and theoretical impedance studies 
of oscillations and bistability in the Ni(II)-SCN electroreduction at the 
streaming mercury electrode, J. Electroanal. Chem., 605, 41-52 (2007). 

11. L. Pospisil, M. Hromadova, M. Gal, M. Valaseka, N. Fanelli and V. 
Kolivoska, Irregular polarographic currents obey Feigenbaum universality 
route from order to chaos, Collect. Czech. Chem. Commun., 74, 1559-1570 
(2009). 

12. V.V. Pototskaya, O.I. Gichan, A.A. Omelchuk, S.V. Volkov, Specific 
features of the behavior of an electrochemical system in the case of the 
Hopf instability for a spherical electrode, Russ. J. Electrochem., 44, 594- 
601 (2008). 

13. A. Sadkowski, Small signal (local) analysis of electrocatalytic reaction. 
Pole-zero approach, J. Electroanal. Chem., 485 119-128 (1999). 

14. P. Strasser, M. Eiswirth and M.T.M. Koper, Mechanistic classification of 
electrochemical oscillators - an operational experimental strategy, J. 
Electroanal. Chem., 478, 50-66 (1999). 

15. F. Seland, R. Tunold, D.A. Harrington, Impedance study of formic acid 
oxidation on platinum electrodes, Electrochim. Acta, 53, 6851-6864 (2008). 



75 



Instructions to Contributors 
Journal of Concrete and Applicable Mathematics 

A quartely international publication of Eudoxus Press, LLC, of TN. 

Editor in Chief: George Anastassiou 

Department of Mathematical Sciences 

University of Memphis 

Memphis, TN 38152-3240, U.S.A. 



1. Manuscripts hard copies in triplicate, and in English, should be submitted to the 
Editor-in-Chief: 

Prof.George A. Anastassiou 

Department of Mathematical Sciences 

The University of Memphis 

Memphis,TN 38152, USA. 

Tel. 901.678.3144 

e-mail: ganastss@memphis.edu 

Authors may want to recommend an associate editor the most related to the 
submission to possibly handle it. 

Also authors may want to submit a list of six possible referees, to be used in case we 
cannot find related referees by ourselves. 



2. Manuscripts should be typed using any of TEX,LaTEX,AMS-TEX,or AMS-LaTEX 
and according to EUDOXUS PRESS, LLC. LATEX STYLE FILE. (Click HERE to 
save a copy of the style file.)They should be carefully prepared in all respects. 
Submitted copies should be brightly printed (not dot-matrix), double spaced, in ten 
point type size, on one side high quality paper 8(1/2 )xll inch. Manuscripts should have 
generous margins on all sides and should not exceed 24 pages. 

3. Submission is a representation that the manuscript has not been published 
previously in this or any other similar form and is not currently under consideration 
for publication elsewhere. A statement transferring from the authors(or their 
employers,if they hold the copyright) to Eudoxus Press, LLC, will be required before 
the manuscript can be accepted for publication.The Editor-in-Chief will supply the 
necessary forms for this transfer. Such a written transfer of copyright,which previously 
was assumed to be implicit in the act of submitting a manuscript,is necessary under the 
U.S.Copyright Law in order for the publisher to carry through the dissemination of 
research results and reviews as widely and effective as possible. 



76 



4. The paper starts with the title of the article, author's name(s) (no titles or degrees), 
author's affiliation(s) and e-mail addresses. The affiliation should comprise the 
department, institution (usually university or company), city, state (and/or nation) and 
mail code. 

The following items, 5 and 6, should be on page no. 1 of the paper. 

5. An abstract is to be provided, preferably no longer than 150 words. 

6. A list of 5 key words is to be provided directly below the abstract. Key words should 
express the precise content of the manuscript, as they are used for indexing purposes. 

The main body of the paper should begin on page no. 1, if possible. 

7. All sections should be numbered with Arabic numerals (such as: 1. 
INTRODUCTION) . 

Subsections should be identified with section and subsection numbers (such as 6.1. 
Second- Value Subheading). 

If applicable, an independent single-number system (one for each category) should be 
used to label all theorems, lemmas, propositions, corrolaries, definitions, remarks, 
examples, etc. The label (such as Lemma 7) should be typed with paragraph 
indentation, followed by a period and the lemma itself. 

8. Mathematical notation must be typeset. Equations should be numbered 
consecutively with Arabic numerals in parentheses placed flush right,and should be 
thusly referred to in the text [such as Eqs.(2) and (5)]. The running title must be placed 
at the top of even numbered pages and the first author's name, et al., must be placed at 
the top of the odd numbed pages. 

9. Illustrations (photographs, drawings, diagrams, and charts) are to be numbered in 
one consecutive series of Arabic numerals. The captions for illustrations should be 
typed double space. All illustrations, charts, tables, etc., must be embedded in the body 
of the manuscript in proper, final, print position. In particular, manuscript, source, 
and PDF file version must be at camera ready stage for publication or they cannot be 
considered. 

Tables are to be numbered (with Roman numerals) and referred to by number in 
the text. Center the title above the table, and type explanatory footnotes (indicated by 
superscript lowercase letters) below the table. 

10. List references alphabetically at the end of the paper and number them 
consecutively. Each must be cited in the text by the appropriate Arabic numeral in 
square brackets on the baseline. 

References should include (in the following order): 
initials of first and middle name, last name of author(s) 
title of article, 



77 



name of publication, volume number, inclusive pages, and year of publication. 
Authors should follow these examples: 

Journal Article 

1. H.H.Gonska,Degree of simultaneous approximation of bivariate functions by Gordon operators, 
(journal name in italics)/. Approx. Theory, 62,170-191(1990). 

Book 

2. G.G.Lorentz, (title of book in italics) Bernstein Polynomials (2nd ed.), Chelsea,New York,1986. 

Contribution to a Book 

3. M.K.Khan, Approximation properties of beta operators,in(title of book in italics) Progress in 
Approximation Theory (P.Nevai and A.Pinkus,eds.), Academic Press, New York,1991,pp.483-495. 

11. All acknowledgements (including those for a grant and financial support) should 
occur in one paragraph that directly precedes the References section. 

12. Footnotes should be avoided. When their use is absolutely necessary, footnotes 
should be numbered consecutively using Arabic numerals and should be typed at the 
bottom of the page to which they refer. Place a line above the footnote, so that it is set 
off from the text. Use the appropriate superscript numeral for citation in the text. 

13. After each revision is made please again submit three hard copies of the revised 
manuscript, including in the final one. And after a manuscript has been accepted for 
publication and with all revisions incorporated, manuscripts, including the 
TEX/LaTex source file and the PDF file, are to be submitted to the Editor's Office on a 
personal-computer disk, 3.5 inch size. Label the disk with clearly written identifying 
information and properly ship, such as: 



Your name, title of article, kind of computer used, kind of software and version number, disk format 
and files names of article, as well as abbreviated journal name. 

Package the disk in a disk mailer or protective cardboard. Make sure contents of disks are identical 
with the ones of final hard copies submitted! 

Note: The Editor's Office cannot accept the disk without the accompanying matching hard copies of 
manuscript. No e-mail final submissions are allowed! The disk submission must be used. 



14. Effective 1 Nov. 2009 for current journal page charges, contact the Editor in 
Chief. Upon acceptance of the paper an invoice will be sent to the contact author. The 
fee payment will be due one month from the invoice date. The article will proceed to 
publication only after the fee is paid. The charges are to be sent, by money order or 
certified check, in US dollars, payable to Eudoxus Press, LLC, to the address shown on 



78 



the Eudoxus homepage . 

No galleys will be sent and the contact author will receive one(l) electronic copy of 
the journal issue in which the article appears. 



15. This journal will consider for publication only papers that contain proofs for 
their listed results. 



79 



TABLE OF CONTENTS, JOURNAL OF CONCRETE AND APPLICABLE 
MATHEMATICS, VOL. 9, NO. 1, 2011 



Temporal and three dimensional spatial analysis of Earthquake activity between 1970 and 
2010 along the North Anatolian fault zone, Turkey, Serkan Ozturk, 9 



Estimating the Nonlinear Behavior of Mitral Valve Doppler Signals, 

Fatma Latifoglu, Esma Uzunhisarc kl , Turker Koza, 17 



Phase diagrams of an Ising System with Competing binary,prolonged ternary and next-nearest 
interactions on a Cayley Tree,Nasir Ganikhodjaev, Hasan Ak n, Selman Uguz, Seyit 
Temir , 26 



Localization of unstable periodical solutions in chaotic systems, Dubrovskiy 
Alexey, 35 



Configuring Time-Lagged Recurrent Neural Network using Strange Attractor's Topological 

Properties, 

M.P. Hanias, H.E. Nistazakis and G.S. Tombras, 40 



Strange attractor in the Potts model on a Cayley tree in the presence of 
competing interactions, N.N. Ganikhodjaev, 47 

On Non- Associativity of Rhesus Factor Transmission, N.N. Ganikhodjaev, 
M.D.Usmanova, 55 



Fractal analysis of macroradiographic images: Legg-Calve-Perthes disease, 
Nebojsa T. Milosevic, Dusan Marie, 60 



Predicting the Onset of Spontaneous Oscillations Using Impedance Method, 
Pototskaya V. V., Gichan O. I., Omel'chuk A.A., 68 



VOLUME 9, NUMBER 2 APRIL 2011 
ISSN: 1548-5390 PRINT,1559-176X ONLINE 




JOURNAL 

OF CONCRETE 

AND APPLICABLE 
MATHEMATICS 

EUDOXUS PRESS,LLC 



GUEST EDITORS : HIKMET CAGLAR, LEVENT CUHACI, 
GURSEL HACIBEKIROGLU and MEHMET OZER 
SPECIAL ISSUE V: "CHAOS and COMPLEX SYSTEMS 2010" 



SCOPE AND PRICES OF THE JOURNAL 
Journal of Concrete and Applicable Mathematics 

A quartely international publication of Eudoxus Press, LLC 

Editor in Chief: George Anastassiou 

Department of Mathematical Sciences, 
University of Memphis 
Memphis, TN 38152, U.S.A. 
ganastss@memphis . edu 

The main purpose of the "Journal of Concrete and Applicable 
Mathematics" is to publish high quality original research articles from 
all subareas of Non-Pure and/or Applicable Mathematics and its many 
real life applications, as well connections to other areas of 
Mathematical Sciences, as long as they are presented in a Concrete way. 
It welcomes also related research survey articles and book reviews. A 
sample list of connected mathematical areas with this publication 
includes and is not restricted to: Applied Analysis, Applied Functional 
Analysis, Probability theory, Stochastic Processes, Approximation 
Theory, O.D.E, P.D.E, Wavelet, Neural Networks, Difference Equations, 
Summability, Fractals, Special Functions, Splines, Asymptotic Analysis, 
Fractional Analysis, Inequalities, Moment Theory, Numerical Functional 
Analysis, Tomography, Asymptotic Expansions, Fourier Analysis, Applied 
Harmonic Analysis, Integral Equations, Signal Analysis, Numerical 
Analysis, Optimization, Operations Research, Linear Programming, 
Fuzzyness, Mathematical Finance, Stochastic Analysis, Game Theory, 
Math. Physics aspects, Applied Real and Complex Analysis, Computational 
Number Theory, Graph Theory, Combinatorics, 

Computer Science Math. related topics, combinations of the above, etc. In 
general any kind of Concretely presented Mathematics which is 
Applicable fits to the scope of this journal. 

Working Concretely and in Applicable Mathematics has become a main 
trend in many recent years, so we can understand better and deeper and 
solve the important problems of our real and scientific world. 
"Journal of Concrete and Applicable Mathematics" is a peer- reviewed 
International Quarterly Journal. 

We are calling for papers for possible publication. The contributor 
should send three copies of the contribution to the editor in-Chief 
typed in TEX, LATEX double spaced. [ See: Instructions to Contributors] 

Journal of Concrete and Applicable Mathematics(JCAAM) 
ISSN: 1548-5390 PRINT, 1559-176X ONLINE. 

is published in January ,April July and October of each year by 

EUDOXUS PRESS,LLC, 

1424 Beaver Trail Drive,Cordova,TN38016,USA, 

Tel.001-901-751-3553 

anastassioug@yahoo.com 

http://www.EudoxusPress.com. 

Visit also www.msci.memphis.edu/~ganastss/jcaam. 

Webmaster:Ray Clapsadle 

Annual Subscription Current Prices:For USA and Canada,Institutional:Print 
$400,Electronic $250,Print and Electronic $450.Individual:Print $150, Electronic 



82 



$80,Print &Electronic $200.For any other part of the world add $50 more to the above 

prices for Print. 

Single article PDF file for individual $15. Single issue in PDF form for individual $60. 

No credit card payments. Only certified check,money order or international check in US 

dollars are acceptable. 

Combination orders of any two from JoCAAA,JCAAM,JAFA receive 25% discount,all 

three receive 30% discount. 

Copyright©201 1 by Eudoxus Press,LLC all rights reserved. JCAAM is printed in USA. 

JCAAM is reviewed and abstracted by AMS Mathematical Reviews,MATHSCI,and 
Zentralblaat MATH. 

It is strictly prohibited the reproduction and transmission of any part of JCAAM and in 
any form and by any means without the written permission of the publisher.lt is only 
allowed to educators to Xerox articles for educational purposes. The publisher assumes no 
responsibility for the content of published papers. 
JCAAM IS A JOURNAL OF RAPID PUBLICATION 



83 



Editorial Board 
Associate Editors 



Editor in -Chief: 

George Anastassiou 

Department, of Mathematical Sciences 

The University Of Memphis 

Memphis, TN 38152, USA 

tel. 901-678-3144, fax 901-678-2480 

e-mail ganastss@memphis.edu 

www.msci .memphis . edu/~anastasg/anly jour .htm 

Areas : Approximation Theory, 

Probability , Moments , Wavelet , 

Neural Networks, Inequalities, Fuzzyness . 

Associate Editors : 

1) Ravi Agarwal 

Florida Institute of Technology 
Applied Mathematics Program 
150 W. University Blvd. 
Melbourne, FL 32901, USA 
agarwal @ fit . edu 

Differential Equations, Difference 
Equations, 
Inequalities 

2 ) Drumi D . Bainov 
Medical University of Sofia 
P.O.Box 45,1504 Sofia, Bulgaria 
drumibainov@yahoo . com 

Differential Equations, Optimal Control, 
Numerical Analysis, Approximation Theory 

3) Carlo Bardaro 

Dipartimento di Matematica & Informatica 
Universita ' di Perugia 
Via Vanvitelli 1 
06123 Perugia, ITALY 
tel. +390755855034, +390755853822, 
fax +390755855024 
bardaro@unipg . it , 
bardaro@dipmat . unipg . it 

Functional Analysis and Approximation Th., 
Summability, Signal Analysis, Integral 
Equations, 
Measure Th.,Real Analysis 

4) Francoise Bastin 
Institute of Mathematics 
University of Liege 
4000 Liege 



21) Gustavo Alberto Perla Menzala 

National Laboratory of Scientific Computation 

LNCC/MCT 

Av. Getulio Vargas 333 

25651-075 Petropolis, RJ 

Caixa Postal 95113, Brasil 

and 

Federal University of Rio de Janeiro 

Institute of Mathematics 

RJ, P.O. Box 68530 Rio de Janeiro, Brasil 

perla@lncc.br and perla@im.ufrj.br 

Phone 55-24-22336068, 55-21-25627513 Ext 224 

FAX 55-24-22315595 

Hyperbolic and Parabolic Partial Differential 

Equations, 

Exact controllability, Nonlinear Lattices and 

Global 

Attractors, Smart Materials 

22) Ram N.Mohapatra 
Department of Mathematics 
University of Central Florida 
Orlando, FL 32816-1364 

tel. 407-823-5080 

ramm@pegasus . cc . ucf . edu 

Real and Complex analysis, Approximation Th., 

Fourier Analysis, Fuzzy Sets and Systems 

23) Rainer Nagel 

Arbeit sbereich Funktionalanalysis 

Mathematisches Institut 

Auf der Morgenstelle 10 

D-72076 Tuebingen 

Germany 

tel . 49-7071-2973242 

fax 49-7071-294322 

rana@f a . uni-tuebingen . de 

evolution equations, semigroups, spectral th., 

positivity 

24) Panos M.Pardalos 

Center for Appl . Optimization 

University of Florida 

303 Weil Hall 

P.O.Box 116595 

Gainesville, FL 32611-6595 

tel. 352-392-9011 

pardalos@uf 1 . edu 

Optimization, Operations Research 



84 



BELGIUM 

f . bastingulg . ac . be 

Functional Analysis, Wavelets 

5) Yeol Je Cho 

Department of Mathematics Education 

College of Education 

Gyeongsang National University 

Chinju 660-701 

KOREA 

tel. 055-751-5673 Office, 

055-755-3644 home, 

fax 055-751-6117 

y jcho@nongae . gsnu . ac . kr 

Nonlinear operator Th. , Inequalities, 

Geometry of Banach Spaces 

6) Sever S.Dragomir 

School of Communications and Informatics 

Victoria University of Technology 

PO Box 14428 

Melbourne City M.C 

Victoria 8001, Australia 

tel 61 3 9688 4437, fax 61 3 9688 4050 

sever . dragomir@ vu . edu . au , 

sever@sci . vu . edu . au 

Math . Analysis , Inequalities , Approximation 

Th. , 

Numerical Analysis, Geometry of Banach 

Spaces, 

Information Th. and Coding 

7) Angelo Favini 
Universita di Bologna 
Dipartimento di Matematica 
Piazza di Porta San Donato 5 
40126 Bologna, ITALY 

tel. ++39 051 2094451 

fax. ++39 051 2094490 

favini@dm.unibo. it 

Partial Differential Equations, Control 

Theory, 

Differential Equations in Banach Spaces 

8) Claudio A. Fernandez 
Facultad de Matematicas 

Pontificia Unversidad Catolica de Chile 

Vicuna Mackenna 4860 

Santiago, Chile 

tel. ++56 2 354 5922 

fax. ++56 2 552 5916 

cf ernand@mat . puc . cl 

Partial Differential Equations, 

Mathematical Physics, 

Scattering and Spectral Theory 



25) Svetlozar T.Rachev 

Dept.of Statistics and Applied Probability 

Program 

University of California, Santa Barbara 

CA 93106-3110, USA 

tel. 805-893-4869 

rachev@pstat . ucsb . edu 

AND 
Chair of Econometrics and Statistics 
School of Economics and Business Engineering 
University of Karlsruhe 
Kollegium am Schloss,Bau II, 20 . 12, R210 
Postf ach 6980 , D-76128 , Karlsruhe , Germany 
tel . 011-49-721-608-7535 
rachev@lsoe . uni-karlsruhe . de 
Mathematical and Empirical Finance, 
Applied Probability, Statistics and Econometrics 

26) John Michael Rassias 
University of Athens 
Pedagogical Department 

Section of Mathematics and Infomatics 

20, Hippocratous Str., Athens, 106 80, Greece 

Address for Correspondence 

4 , Agamemnonos Str . 

Aghia Paraskevi, Athens, Attikis 15342 Greece 

jrassias@primedu . uoa . gr 

jrassias@tellas . gr 

Approximation Theory, Functional Equations, 

Inequalities, PDE 

27) Paolo Emilio Ricci 

Universita' degli Studi di Roma "La Sapienza" 

Dipartimento di Matematica-Istituto 

"G . Castelnuovo" 

P.le A. Moro, 2-00185 Roma, ITALY 

tel. ++39 0649913201, fax ++39 0644701007 

riccip@uniromal . it , Paoloemilio . Ricci@uniromal . it 

Orthogonal Polynomials and Special functions, 

Numerical Analysis, Transforms, Operational 

Calculus, 

Differential and Difference equations 

28) Cecil C.Rousseau 

Department of Mathematical Sciences 
The University of Memphis 
Memphis, TN 38152, USA 
tel. 901-678-2490, fax 901-678-2480 
ccrousse@memphis . edu 
Combinatorics , Graph Th . , 
Asymptotic Approximations , 
Applications to Physics 

29) Tomasz Rychlik 



85 



9) A.M. Fink 

Department, of Mathematics 
Iowa State University 
Ames,IA 50011-0001, USA 
tel. 515-294-8150 

f inkgmath . iastate . edu 
Inequalities, Ordinary Differential 
Equations 

10) Sorin Gal 
Department of Mathematics 
University of Oradea 
Str.Armatei Romane 5 
3700 Oradea, Romania 
galso@uoradea . ro 

Approximation Th. , Fuzzyness, Complex 
Analysis 

11) Jerome A.Goldstein 
Department of Mathematical Sciences 
The University of Memphis, 
Memphis, TN 38152, USA 

tel. 901-678-2484 
jgoldste@memphis . edu 
Partial Differential Equations, 
Semigroups of Operators 

12) Heiner H.Gonska 
Department of Mathematics 
University of Duisburg 
Duisburg, D-47048 
Germany 

tel. 0049-203-379-3542 office 
gonska@inf ormatik . uni-duisburg . de 
Approximation Th . , Computer Aided 
Geometric Design 

13) Dmitry Khavinson 

Department of Mathematical Sciences 

University of Arkansas 

Fayetteville,AR 72701, USA 

tel. (479) 575-6331, fax(479) 575-8630 

dmitry@uark . edu 

Potential Th., Complex Analysis, Holomorphic 

PDE, 

Approximation Th . , Function Th . 

14) Virginia S.Kiryakova 

Institute of Mathematics and Informatics 

Bulgarian Academy of Sciences 

Sofia 1090, Bulgaria 

virginia@diogenes.bg 

Special Functions, Integral Transforms, 

Fractional Calculus 

15) Hans-Bernd Knoop 



Institute of Mathematics 

Polish Academy of Sciences 

Chopina 12,87100 Torun, Poland 

T . Rychlik@impan . gov . pi 

Mathematical Statistics , Probabilistic 

Inequalities 

30) Bl. Sendov 

Institute of Mathematics and Informatics 

Bulgarian Academy of Sciences 

Sofia 1090, Bulgaria 

bsendov@bas .bg 

Approximation Th., Geometry of Polynomials, 

Image Compression 

31) Igor Shevchuk 

Faculty of Mathematics and Mechanics 

National Taras Shevchenko 

University of Kyiv 

252017 Kyiv 

UKRAINE 

shevchuk@univ . kiev . ua 

Approximation Theory 

32) H.M.Srivastava 

Department of Mathematics and Statistics 

University of Victoria 

Victoria, British Columbia V8W 3P4 

Canada 

tel. 250-721-7455 of f ice, 250-477-6960 home, 

fax 250-721-8962 

harimsri@math . uvic . ca 

Real and Complex Analysis, Fractional Calculus 

and Appl . , 

Integral Equations and Transforms, Higher 

Transcendental 

Functions and Appl . , q-Series and q-Polynomials, 

Analytic Number Th. 



33) Stevo Stevic 

Mathematical Institute of the Serbian Acad. 

Science 

Knez Mihailova 35/1 

11000 Beograd, Serbia 

sstevic@ptt . yu; sstevo@matf . bg . ac . yu 

Complex Variables, Difference Equations, 

Approximation Th., Inequalities 

34) Ferenc Szidarovszky 

Dept . Systems and Industrial Engineering 

The University of Arizona 

Engineering Building, 111 

PO.Box 210020 

Tucson, AZ 85721-0020, USA 

szidar@sie . arizona . edu 

Numerical Methods, Game Th., Dynamic Systems, 



of 



86 



Institute of Mathematics 

Gerhard Mercator University 

D-47048 Duisburg 

Germany 

tel . 0049-203-379-2676 

knoop@math . uni-duisburg . de 

Approximation Theory, Interpolation 

16) Jerry Koliha 

Dept . of Mathematics & Statistics 

University of Melbourne 

VIC 30 10, Melbourne 

Australia 

koliha@unimelb . edu . au 

Inequalities, Operator Theory, 

Matrix Analysis, Generalized Inverses 

17) Mustafa Kulenovic 
Department of Mathematics 
University of Rhode Island 
Kingston, RI 02881, USA 
kulenm@math . uri . edu 

Differential and Difference Equations 

18) Gerassimos Ladas 
Department of Mathematics 
University of Rhode Island 
Kingston, RI 02881, USA 
gladas@math . uri . edu 

Differential and Difference Equations 

19) V. Lakshmikantham 
Department of Mathematical Sciences 
Florida Institute of Technology 
Melbourne, FL 32901 

e-mail: lakshmik@fit.edu 

Ordinary and Partial Differential 

Equations, 

Hybrid Systems, Nonlinear Analysis 

20) Rupert Lasser 

Institut fur Biomathematik & Biomertie, GSF 

-National Research Center for environment 

and health 

Ingolstaedter landstr.l 

D-85764 Neuherberg, Germany 

lasser@gsf.de 

Orthogonal Polynomials, Fourier Analysis, 

Mathematical Biology 



Multicriteria Decision making, 
Conflict Resolution, Applications 
in Economics and Natural Resources 
Management 

35) Gancho Tachev 
Dept . of Mathematics 

Univ. of Architecture, Civil Eng. and Geodesy 
1 Hr . Smirnenski blvd 
BG-1421 Sofia, Bulgaria 
gtt_f te@uacg . bg 
Approximation Theory 

36) Manfred Tasche 
Department of Mathematics 
University of Rostock 
D-18051 Rostock 
Germany 

manf red . tasche@mathematik . uni-rostock . de 
Approximation Th. , Wavelet, Fourier Analysis, 
Numerical Methods , Signal Processing, 
Image Processing, Harmonic Analysis 

37) Chris P.Tsokos 
Department of Mathematics 
University of South Florida 
4202 E. Fowler Ave., PHY 114 
Tampa, FL 33620-5700, USA 

prof cpt@math. usf.edu, prof cpt@chumal . cas .usf.edu 
Stochastic Systems , Biomathematics , 
Environmental Systems , Reliability Th . 

38) Lutz Volkmann 
Lehrstuhl II fuer Mathematik 
RWTH-Aachen 
Templergraben 55 

D-52062 Aachen 

Germany 

volkm@math2 . rwth-aachen . de 

Complex Analysis, Combinatorics, Graph Theory 



87 



Preface 



These six special issues, which constitute the proceedings of the symposium 3rd 
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Abarbanel, Prof. David S. Byrne, Prof. George Anastassiou, Prof. Zidong Wang, Prof. Turgut 
Ozis and Prof. Markus J. Aschwanden. 

Special thanks are due to Rector Prof. Dursun Kocer and Vice Rector Prof. Cetin Bolcal for 
their close support, advice and incentive encouraging. 
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and provided all of its facilities. 
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Computing the approximate frequency for nonlinear oscillators with discontinuities by 

He's bookkeeping parameter method 

Canan K6roglu a Turgut Ozis b 

d Department of Mathematics, Faculty of Science, Hacettepe University, Campus, 06800, 
Beytepe-Ankara, Turkey, Email: ckoroglu@hacettepe.edu.tr 

b Department of Mathematics, Faculty of Science, Ege University, Campus, 35100, Bornova- 
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Abstract: In this paper, we have considered two examples of nonlinear oscillators with 
discontinuities by using Ji-Huan He's parameter-expanding method with an adjustment of 
restoring forces in terms of Chebyshev's series. The results found using this procedure are more 
accurate than those found using other approximate methods. 

Keywords: Parameter-expanding method, Nonlinear oscillator 

PACS numbers: 02.30.Jr, 02.30.Lt, 02.30.-f 

1. Introduction 

Nonlinear oscillations in engineering, physics, applied mathematics and in many real world 
applications has been a topic to intensive research for many years and several methods have been 
used to find approximate solutions to nonlinear oscillators [1-4]. In general, given the nature of a 
nonlinear phenomenon, the approximate methods can only be applied within certain ranges of 
the physical parameters and to certain classes of problems. However, the use of perturbation 
theory in many significant practical problems is invalid, or it simply breaks down for parameters 
beyond a certain specified range. Therefore, new analytical/approximate methods should be 
developed to beat these weaknesses. 

Such a new method should labor over a large range of parameters and give accurate 
analytical approximate solutions beyond the coverage and ability of the classical perturbation 
methods. 

For nonlinear oscillators, some of these methods include harmonic balance method [5-10], 
variational iteration method [11-16], homotopy perturbation method [17-23].Also there are some 
other method surveys of the literature with numerous references and useful bibliography and a 
review of these methods can be found in detail in [24-26]. 
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In this paper, we adapted He's bookkeeping parameter method [27] with an adjustment of 
restoring forces in terms of Chebyshev's series for nonlinear oscillators with discontinuities. 

2. Parameter-expanding methods 

In case no small parameter exists in a nonlinear equation, traditional perturbation methods cannot 
be directly applied. For this type of problem Ji Huan He [27] developed a technique where a 
bookkeeping parameter is introduced to the original differential equation. Recently parameter- 
expanding methods [28-35] including bookkeeping parameter method [27] and modified 
Lindstedt-Poincare methods [36-43] have been caught much attention; the parameter expansion 
can also be applied to homotopy perturbation method [44-45]. 

We, now, consider the following two examples for nonlinear oscillators with discontinuities. 

Example 1: Ramos [54] has recently analyzed the nonlinear differential equation 

u" = -sign(u),u(p) = A,u'(0) = (1) 

( l,u > 
where sign(u) = 1—1,14 < 
[ 0,u = 

Re- written Eq. (1) in the form 

u" +0.u + l.sign(u) = 0,u(0) = A,u'(Q) = (2) 

Suppose that the solution can be expressed as a power series in p: 

u = u + pu x + p 2 u 2 + ■■• (3) 

where p is a bookkeeping parameter. 

We also suppose that the coefficients and 1 in the left side of Eq.(2) can be, respectively, 
expanded into a series in p: 

= w 2 + pw 1 + p 2 w 2 + ••• (4) 

1 = a x p + a 2 p 2 + ••• (5) 

Substituting Eqs.(4) and (5) into Eq.(2) and equating the terms with the identical powers of p, we 
have 
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P°:u'q +w 2 u = 0,u (0) =A,u' (0) = (6) 

p 1 : v!{ + w^q + w 2 u x + a x sign(u^) = (7) 

The solution of (6) is u = Acos(wt). Substituting u into Eq.(7) results into 

u" + w 2 u x + w 1 i4cos(wt) + a x sign{Acos(wt)) = 0. (8) 

From Chebyshev series expansion, we have 

f\X) = Z.n=0 c 2n+lT2n+l( x )> 

where x=cos(wt), r 2n+1 (x) = cos [(2n + l)wt] and the coefficients: 

C 2 n+1 = - Lfi- - * 2 ) ^/OO^Zn+lOOd* 

Through /"(x) = sign(Acos6), (for A>0) coefficients form: 

c 2n+i = ~/ sign(cos 6) cos[(2n + 1)0] d# 
And for n=0 gives (0=wt) 

c 1 =-/ sign(cos6)cos6d6 (9) 



7T 7T 

Noting that sign(cosO)=l when 0<0<- , and sign(cosO)=-l when - < 6 < n, so we write Eq.(9) 
in the form 

c-i = -[J 2 sign(cos6)cos6d6 + L, sign(cos6)cos8d6 

7T / 2 



2 4 

Cl =-(1 + 1) = - 

No secular terms in u x requires w x = —w 2 , a t = 1 
and 

4 

Wii4 + a, - = 0. 

n 

Thus, the first order approximation found as 
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W 2 =— (10) 

Eq. (10) is the same result as Ramos' solution [54] using the method of variation of parameters 
and Liu' solution [55] which according to the modified Lindstedt-Poincare method. 

Example 2: We, now, view the following nonlinear oscillator with discontinuity [56]: 
u" +u\u\ = 0,u(0) = A,u'(0) = 0. (11) 

Eq. (11) was studied Wang and He [56]. 

We re- write Eq. (1 1) in the following form: 

u" +0.U + l.u\u\ = (12) 

We expand the solution, u, the constant, zero, and the coefficient of u\u\, 1, in series of p: 
u = u + pu x + p 2 u 2 + ••• (13) 

= w 2 + pw 1 +p 2 w 2 + ••• (14) 

1 = a x p + a 2 p 2 + ••• (15) 

Substituting Eqs.(14) and (15) into Eq.(12) and equating the terms with the identical powers of p, 
we have 

p°:u'^ +w 2 u = 0,u (0) = A,u' Q (fi) = (16) 

p 1 : u" + w-lUq + w 2 u x + a x sign(u^) = (17) 

The solution of (16) is u = Acos(wt). Substituting u into Eq.(17) results into 

u'l + w 2 u x + WiAcosiwt) + a x A 2 cos(wt) |cos(wt)| = 0. (18) 

From Chebyshev series expansion, we have 

J (Xj = Zm=0 c 2n+l'2n+l( x )' 

where x=cos(wt), T 2n+1 (x) = cos [(2n + l)wt] and the coefficients: 

c 2 n+i = ^/-V 1 - * 2 ) /2 f(x)T 2n+1 (x)dx. 
Through f{x) = cos9\cos9\, coefficients form: 

Czn+i =- f^ (cos 9)\cos0\ cos[(2n + 1)6] d6 
And for n=0 gives (0=wt) 
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Cl =-Ccos 2 B\cosB\de =-(C /2 cos 3 B dB - r,cos 3 0do) = — 

1 7T J ' ' 7T\ J J n/2 ) 3n 

No secular terms in u x requires 

8 T 

a x A h w x — and w t = —w , a x = 1 

Thus, the first order approximation found as 

w = — « 2.6667 - (19) 

AJ37T Aj7T V 

Above the obtained frequency is valid for 0<A<co. This result same as Wang and He's solution 
[56]. 

3. Conclusion 

In this paper, we have represented Ji-Huan He's parameter-expanding method with two 
examples. The parameter-expanding method with an adjustment of restoring forces in terms of 
Chebyshev's series for nonlinear oscillators with discontinuities proved to be a powerful 
mathematical tool to nonlinear oscillators. The technology can be easily extended to any 
nonlinear oscillators, and the present short note can be used as prototype for many other 
applications in searching for period or frequency of various nonlinear oscillators. 
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Abstract 

The concept of "self-organized criticality" (SOC) has been introduced 
by Bak, Tang, and Wiesenfeld (1987) to describe the statistics of avalanches 
on the surface of a sandpile with a critical slope, which produces a scale- 
free powerlaw size distribution of avalanches. In the meantime, SOC be- 
havior has been identified in many nonlinear dissipative systems that are 
driven to a critical state. On a most general level, SOC is the statis- 
tics of coherent nonlinear processes, in contrast to the Poisson statistics 
of incoherent random processes. The SOC concept has been applied to 
laboratory experiments (of rice or sand piles), to human activities (popu- 
lation growth, language, economy, traffic jams, wars), to biophysics, geo- 
physics (earthquakes, landslides, forest fires), magnetospheric physics, so- 
lar physics (flares), stellar physics (flares, cataclysmic variables, accretion 
disks, black holes, pulsar glitches, gamma ray bursts), and to galactic 
physics and cosmology. 

Keywords: astrophysics - nonlinear dynamics - statistics - selforganizcd critical- 
ity - solar flares 

1 Introduction 

Physical processes in our universe can be subdivided into incoherent and co- 
herent processes. Examples of incoherent processes arc fractional Brownian 
motion, diffusion, collisional plasma processes, plasma heating, which all are 
governed by random processes and thus can be described by binomial and Pois- 
sonian statistics, which exhibit exponential- like or Gaussian- like distributions. 
In contrast, coherent processes overcome the threshold of the random noise 
background and grow in a multiplicative way, such as avalanches, chain reac- 
tions, or catastrophes, which all exhibit powerlaw-like size distributions. The 
dychotomy of incoherent and coherent processes is also reflected in the two types 
of linear and nonlinear processes. Linear systems are characterized by a propor- 
tionality between the input and output (Fig. 1, left). Small disturbances cause 
small effects, and large disturbances are required to produce a large effect. A hy- 
dropower plant, for instance, produces electric energy that is proportional to the 
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Figure 1: The output or dissipated energy in a linear system grows linearly with 
time, for a constant input rate (left), while the output is highly unpredictable and not 
correlated with the input rate in a nonlinear dissipative system (right). 

water inflow rate and gravitational or kinetic energy of the water that is feeding 
the turbine. Nonlinear processes, in contrast, are governed by a multiplicative 
or amplification factor (Fig. 1, right), that leads to outputs of unpredictable 
magnitude, unlike linear systems. Small disturbances can cause both small or 
large avalanches. Classical examples are snow avalanches, landslides, floodings, 
forest fires, or earthquakes. 

A conceptual model to understand the basic nature of nonlinear processes 
was introduced by Bak, Tang, and Wiesenfeld (1987) in terms of sandpilc 
avalanches. We can build a sandpile by dripping sand grains randomly with 
a more or less steady rate, until it forms a cone. Once the sandpile reaches a 
critical slope (typically at an angle of repose of ss 34° — 37°), avalanches occur in 
an unpredictable way, even when the input of dripped sand grains is steady. Bak 
called this driven state " self-organized criticality" (SOC), which has become 
a paramount characteristic of many nonlinear systems (Aschwanden 2010). A 
sand beach, in contrast, would be in a sub-critical state without avalanches. The 
key features of nonlinear systems arc powerlaw-likc size distributions, which in- 
dicate scale-free parameter distributions, such as the size, time scale, or energy 
of an avalanche. The occurrence frequency distribution N(x) of a parameter x 
is defined as a powerlaw function when 



N{x) ex x 



(1) 



The mathematical nature of such powerlaw distributions can easily be under- 
stood in terms of a coherent, exponential growth process as described in the 
following section. 

2 Analytical Model of SOC Avalanches 

Avalanches occurring in the state of self-organized criticality represent local 
instabilities that grow explosively for some time interval. The released energy 
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Figure 2: Time evolution of energy release rate W(i) for 3 different ratios of growth 
times to saturation times, TG/ts = (0.5, 1.0, 2.0) (left) and the corresponding powerlaw 
distributions of the peak energy release rate P. Note that the event set with the 
shortest growth time (rafts — 0.5) reaches the highest energies and thus produces the 
flattest powerlaw slope (a = 1 + rafts — 1.5). 



grows in a nonlinear way above some energy threshold, which can be parameter- 
ized by some nonlinear function, for instance by an exponential growth function. 
We define the time evolution of the energy release rate W(t) of a nonlinear pro- 
cess that starts at a threshold energy of Wq by 



W(t) = Wo cxp 



0<t <T 



(2) 



where tq represents the exponential growth time. The process grows exponen- 
tially until it saturates at time t — r with a saturation energy Ws, 



W s = W(t = t) = W exp 



TG 



(3) 



We define a peak energy release rate P that represents the maximum energy 
release rate Ws, after subtraction of the threshold energy Wo, that corresponds 
to the steady-state energy level before the nonlinear growth phase, 



P = W s - W = Wo 



cxp 



- 1 



(4) 



In the following, we will refer to the peak energy release rate P also briefly 
as "peak energy" . For the saturation times r, which we also call "rise times" , 
we assume a random probability distribution, approximated by an exponential 
function N(t) with e-folding time constant ts, 



N(T)dT = — cxp 
ts 



-^)dr. 
ts) 



(5) 



This probability distribution is normalized to the total number of Nq events, 

N{r)dT = No . (6) 
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In order to derive the probability distribution N(P) of peak energy release rates 
P, we have to substitute the variable of the peak energy, P, into the function 
of the rise time t(P), 



N(P)dP = N{r)dT = N[t(P)] 



<1t 



dP . (7) 



dP 
This requires the inversion of the evolution function P(t) (Eq. 4), 

r(P) = r G In (^ + l) , (8) 

and the calculation of its derivative dr/dP, which is 

Inserting the probability distribution of saturation times N(t) (Eq. 5), the in- 
verted evolution function t(P) (Eq. 8) and its time derivative (dr/dP) from 
Eq. (9) into the frequency distribution N(P) in Eq. (7) yields then, 

which is an exact powerlaw distribution for large peak energies (P 3> Wq) with 
a powerlaw slope a of 

«=(i + f). (id 

The same mathematical result was derived in Rosner and Vaiana (1978), but 
the exponential growth was attributed to energy storage therein, rather than 
to the nonlinear growth phase of the instability here. The powerlaw slope thus 
depends on the ratio of the growth time to the e-folding saturation time, which 
is essentially the average number of growth times. Examples of time series with 
avalanches of different growth times (rafts = 0.5, 1.0, 2.0) are shown in Fig. 2, 
along with the corresponding powerlaw distributions of peak energies P. Note 
that the fastest growing events produce the flattest powerlaw distribution of 
peak energies. 

This simple model explains the powerlaw distribution of peak energies in 
nonlinear processes that have an exponential-like growth, which is the key char- 
acteristic of coherent processes. In incoherent processes, the growth time would 
be much larger than the average saturation time (tg 3> ts), in which case the 
time evolution (Eq. 3) can be linearized, leading to P ex r (Eq. 4), and the 
distribution of peak energies would be identical to that of the saturation times 
r, which is a Poissonian (exponential) distribution (Eq. 5) with a characteris- 
tic scale P ~ Wq. So, incoherent processes would have the same exponential 
distribution of peak fluxes P as their random durations r, 

Nmc ^ dp = w^{-w) dp - (12) 
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Therefore, we can use the functional shape of the occurrence frequency distribu- 
tion of event sizes as a diagnostic of linear or nonlinear processes: exponential 
distribution functions indicate an incoherent random process, while powerlaw 
distribution functions indicate a coherent growth process. 

The exponential-growth model represents just the mathematically simplest 
function to produce a powerlaw distribution of peak energies. It corresponds 
to a multiplicative process where the number of avalanche elements doubles 
every time step until it saturates (Fig. 3, left). The saturation phase, how- 
ever, abruptly ends with a discontinuity. A more natural model is the logistic 
equation (discovered by Pierre Francois Verhulst in 1845), which is a first-order 
differential equation that approaches the saturation limit asymptotically, 



dE(t) _ E(t) 
dt t g 



E„o 



(13) 



as shown in Fig. 3 (right). The time derivative, which mimics the energy re- 
lease rate, has a maximum when the total energy has the steepest slope. The 
avalanche grows first exponentially and dies out gradually after the peak time of 
the fastest growth. It can be shown mathematically that the frequency distribu- 
tion of the peak energies is also a powerlaw (Aschwanden et al. 1998), and thus 
this more physical description of a logistic avalanche with a continuous time 
evolution shares the same characteristic as an exponentially-growing avalanche, 
and thus both models can be used to describe SOC processes. 

3 Solar Observations of SOC Phenomena 

Solar flares are probably the best-studied datasets regarding SOC statistics in 
astrophysics. Solar flares are catastrophic events in the solar corona, most likely 
caused by a magnetic instability that triggers a magnetic reconnection process, 
producing emission in almost all wavelengths, such as in gamma-rays, hard X- 
rays, soft X-rays, extreme ultraviolet (EUV), Ha emission, radio wavelengths, 
and sometimes even in white light. EUV images of solar flares display a complex 
topology of the magnetic field produced by a magnetic reconnection process. 
Since the emission mechanisms are all different in each wavelength, such as 
nonthermal bremsstrahlung (in hard X-rays), thermal bremsstrahlung (in soft 
X-rays and EUV), gyrosynchrotron emission (in microwaves), plasma emission 
(in metric and decimetric waves), etc., we expect that the calculation of energies 
contained in each event strongly depends on the emission mechanism, and thus 
on the wavelength. It is therefore advisable to investigate the statistics of SOC 
events in each wavelength domain separately. The most unambiguous SOC 
parameters to report are the peak flux P, the total flux or fluence E, defined as 
the time-integrated flux over the entire event, and the total time duration T of 
the event. Conversions of fluxes and fluences into energy release rates and total 
energies require physical models. 

Statistics of the peak count rates P of over 20,000 solar flares observed 
in hard X-rays during three different space missions (SMM 1980-1989; CGRO 
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Figure 3: Time evolution of total released energy e(t) (top panels), the energy re- 
lease rate W(t) = de(t)/dt (middle panels), and binary representation of avalanche 
growth rate (bottom panels), for both the exponential (left panels) and the logistic 
growth model (right panels). An exponential curve (right top) and a Gaussian curve 
(right middle) are drawn (with dotted lines) onto the logistic curves for comparison 
(Aschwanden et al. 1998). 
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HXRBS/SMM 1980-1989 N=11549, a P = 1.79 
. BATSE/CGRO 1 991 -1 993N= 41 09, <x P = 1 .69 
. RHESSI 2002-2007 N=1 1 595, a P = 1.77 



a P =1 .75+0.05 




10 3 10" 

Peak counts P(cts/s) 



Figure 4: Occurrence frequency distributions of hard X-ray peak count rates P(cts/s) 
observed with HXRBS/SMM (1980-1989), BATSE (1991-1993), and RHESSI (2002- 
2007), with powerlaw fits. Note that BATSE/CGRO has larger detector areas, and 
thus records higher count rates. 
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Figure 5: Composite flare frequency distribution in a normalized scale in units of 
10 -50 flares per time unit (s -1 ), area unit (cm -2 ), and energy unit (erg -1 ). The 
energy is defined in terms of thermal energy E t h = 3n e kBT e V for EUV and SXR, and 
in terms of non-thermal energy in > 25 keV (Crosby et al. 1993) or > 8 keV electrons 
(Lin et al. 2001). The slope of —1.8 is extended over the entire energy domain of 
10 24 — 10 32 erg. The offset between the two HXR datasets is attributed to different 
lower energy cutoffs as well as different levels of flare activity during the observed time 
intervals [adapted from Aschwanden et al. 2000 and Lin et al. 2001]. 
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Figure 6: Cumulative occurrence frequency distributions N(> E) of stellar flares 
(vertically shifted for each star, in order of stellar distance) are shown as a function 
of the flare energy E, observed from 12 different stars by Audard et al. (2000). For 
comparison we show also the statistics of total hard X-ray emission of 18,888 solar 
flares observed with RHESSI, which covers an energy range of E ~ 10 27,0 — 10 31 ' 7 
ergs, while stellar flares have an energy range of E ~ 10 30 ' 7 — 10 350 ergs. Note that 
most distributions show a (cumulative) powerlaw part with a slope of a ~ 0.8 (diagonal 
lines) at the low end and an exponential high-energy drop-off. 
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1991-1993; RHESSI 2002-2010) and during three different solar cycles have been 
gathered and their occurrence frequency distributions (or log N - log S distri- 
butions) are shown in Fig. 4. All three datasets show a near-perfect powerlaw 
distribution function with a mean slope of ap — 1.75 ± 0.05. According to our 
model this value corresponds to a ratio of rafts — 0.75 (Eq. 11) or a mean 
saturation time tgJTQ = 1.33 growth times. The distributions shown in Fig. 4 
span together over 5 orders of magnitude, which means that the largest flare 
had a maximum saturation time of ln(10 5 ) = 11.5 growth times, which cor- 
responds to an extremely coherent process that could never be explained by 
random probability. 

Similar powerlaw-likc occurrence frequency distributions have also been found 
for other flare parameters, such as the fluence, the flare duration, or flare en- 
ergy (calculated from the thermal energy or energy in nonthermal hard X-ray 
producing electrons). Based on this fact of scale-free powerlaw distributions, 
Lu and Hamilton (1991) were the first to apply the concept of self-organized 
criticality (SOC) to solar flares. With a cellular automaton model that mimics 
sandpile avalanches, they were able to simulate the size frequency distribution 
with a powerlaw slope of ap — 1.67 ± 0.02, which is close to the observed value 
of ap = 1.75 ± 0.05 shown in Fig. 4. 

The statistics of peak energies in solar flares has been extended to other 
wavelengths, from hard X-rays to soft X-rays and EUV and the powcrlaw-like 
size distribution has been found to extend over 8 orders of magnitude (Fig. 5). 
The events observed in soft X-rays have been called "active region transients" , 
having about 3-5 orders of magnitude less energy than the largest solar flare. 
The events observed in EUV have energies about 6-9 orders of magnitude less 
than the largest flare, and thus are called "nanoHares" . The self-similarity of 
flare parameters observed over this wide wavelength range, which implies also a 
large temperature range of T « (1 — 35) x 10 6 K, constitutes a powerful argument 
that the solar corona is in a state of self-organized criticality. 

4 Astrophysical Observations of SOC Phenom- 
ena 

Size distributions have also been sampled for stellar flares, although with much 
smaller statistics, typically < 15 flare events per star. A comparison of size 
distributions from 12 flare stars (type F to M) observed by Audard et al. (2000) 
is shown in Fig. 6. Because of the smallness of the samples, the cumulative fre- 
quency distributions arc shown, which have slope that is flatter by one compared 
with the differential frequency distribution (a c p m = ap — 1). The comparison 
in Fig. 6 demonstrates two important aspects: (1) stellar flares are up to two 
orders of magnitude more energetic (E m 10 32 — 10 34 ) than solar flares (see 
RHESSI comparison at bottom of Fig. 6), although the small sample implies 
common and relatively weak events, and (2) the drop-off at the upper bound of 
the cumulative frequency distribution yields a steeper slope than the powerlaw 
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Log F (Jy) 



Figure 7: Frequency distribution of giant-pulse flux densities measured from the 
Crab pulsar, observed during 15-27 May 1991 with the Green Bank 43-m telescope at 
1330, 800, and 812.5 MHz. The tail can be represented by a powerlaw distribution 
N F oc F~ a with a = 3.46 ± 0.04 for fluxes F > 200 Jy (Lundgen et al. 1995). 



slope obtained from more complete frequency distributions. Correcting for the 
latter effect, stellar flares seem to have a similar powerlaw distribution as solar 
flares, and thus may be goverend by the same SOC process. 

Other size distributions with powerlaw shape have been observed in astro- 
physical data for pulsar glitches (e.g., Lundgren et al. 1995; shown in Fig. 7), 
for soft gamma-ray repeaters (e.g., Gogus et al. 1999), accretion disk objects 
around black hole candidates, such as Cygnus X-l (e.g., Negoro et al. 1995), 
or for blazars (e.g., Ciprini et al. 2003). These astrophysical objects display 
size distributions with different powerlaw values, and thus can be explained by 
different physical processes, but the distribution type of a powerlaw function 
constitutes a powerful argument that the underlying system is driven into the 
critical state of self-organized criticality, which is common to earthquakes, sun- 
quakes (occurring during large flares), and neutron star quakes (pulsar glitches). 
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Abstract. In this article we continue the study of Lp approxima- 
tion, 1 < p < oo, by the smooth Poisson-Cauchy Type singular 
integral operators with their applications. We establish here also 
Lipschitz type results of approximation for these operators. Fur- 
thermore we produce some particular Voronovskaya type results. 

1 Introduction 

We are motivated by [5], [6]. 

We denote by L p , 1 < p < oo, the classes of functions / (x) , integrable in 
-co < x < co with the norm 



\f\\ P 



\f(u)fdu 



(1) 
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The Poisson-Cauchy singular integral M^(f;x) corresponding to the func- 
tion / (x) , is defined as follows 

,00 1 

Mt(f t x):=W f(x + y)- —gdy, for all x e R, £ > 0, (2) 

J -00 {y 2a + e a ) 

where 

W = m*^ (3) 

and a e N, /3 > ^. We assume that / is such that M c (/; a;) el,Vi€ R, V£ > 0. 

For suitable choices of a,f3 (see [5], for a = 1,(3 = 1) we have, for / <G 

L p , 1 < p < 00, that the integral (2) exists for all x € (—00,00) and £ > 0, and 

for functions / (x) from the class L p n C°° , it satisfies the following expressions 

l|M £ (/,-)|| p <||/|| p ,£>0, £m ||M ? (/,-)-/Oll p = 0. (4) 

The Poisson-Cauchy singular integral plays an important role in the theory of 
second-order partial differential equations. It can be shown to be the solution 
of the Dirichlet problem for Laplace's equation in the upper half-plane with 
boundary function / (x) G L p , 1 < p < 00. 

Here we give important applications of the main results from [1] , [2] , [3] and 
[4]- 

2 Uniform Convergence 

Let /: R — > R be a Lebesgue measurable function. Next we define and study 
the smooth Poisson-Cauchy singular integral type operators M r ^(/;x). 
For r € N and n <G Z + we set 

(-iy- j Qr n , j = i,...,r, 



(5) 



r 

that is y^ a.j = 1. 
i=o 
Let £, > 0,a e N,(3 > ■£- and x G R. We consider the Lebesgue integral, 

00 E;=o«3/(g+ i«) 
(t 2 « + t, 2a ) 

where the constant W is given by (3). 

Note 1. The operators M r ^ are not in general positive, see [1] 



M r ,t(f;x):=W J _ 2a J ^ ( 6 ) 
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Note 2. In particular we have M\^ — M^. 

Here let / e C"(R) with to 1 (f ( ^ n \h) < oo, h > 0, n E N. Assume 
Mj£(f;x) € K for j = 1, . . .,r e N, £ > 0, all x e R. Also suppose that 

/3 > "+ 2 



2« - 

We call also 



^2m := ^ Oj.f 



(7) 



and 



«2m? j 



l™/2J jr(2m)/-„1 p f gm+l \ r (o _ 2m+P 

'* '' £i ( 2 -) ! r (^) r (/3-2<*) 

(8) 
x € K. ['J denotes the integral part, the sum collapses for n = 1. 

We study here the convergence of operators M r] j to the unit operator I with 
rates, reN. 
For n = 1, 

E r£ (f;x) = M r ^f;x)-f(x). 

We give 

Theorem 3. Let n = 1. Then 



(i) for a = 1 and /3 = § 

||M r , £ (/;.)-/||oc< 
(ii) for a = 2 and j3 = 1 

||M r , c (/;-)-/||oo< 



1 r 

-F 



• ? + 1+ 27 



ewi(/',o,^>o, (9) 



^G)( J + 7i + ^ 



ewi(/',0, £>o, (10) 



(hi) for a = 2 and /3 = | 



||M^(/;.)-/|U< 



1 r 

.7=1 V 



(.7 + 1) 



7TV27T 1 



(iv) for a = 3 and /3 = 1 



(ii) 



|M r>c (/;-)-/||oo< 



E 
j=i 



4 + 2\/3 + 8j 



ewi(/',o. e>o, (12) 
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(v) for a — 3 and (3 = | 



||M r , € (/;.)-/||oc< 


teo 


(vi) for a — 3 and j3 = I 


V^(/; - /lloo < 


go 


— \/n- 

2 V I 


(vii) for a = 4 an 


d/3 


__ i 

2 





23 1 

7 + -p + ~r- 



ewi(/',o. ?>o, (13) 



||M r , £ (/;-)-/||oo< 



E 



:£(§) , VJT(I) , 1 

2 v "r(i) + 2lr(i) + 8, 



i , i [r(|)] 2 
2 + 2r(|)r(l) 



(viii) for a = 4 and /3 



(14) 



(15) 



||M r , £ (/;-)-/||oo< 



E 



■3 = 1 

(ix) for a — 4 and /3 — 1 



j r(|)r(l) i r(i)r(l) i 
2 r(|) + 2 r(|) + 8, 



(16) 



||M r , £ (/;-)-/||oo< 



e: 



i=i 



1 . 7tt 



- sin — 7 esc — 

2 8 J 8 



•5tt 



/2l + « 



(x) for a = 4 and /? 



(17) 



||M r , £ (/;-)-/||oo< 



E 



i , i [r(i)] 2 , i 
6 + 3r(|)r(|) + 8. ? 



(xi) for a — 5 and /3 = | 



||M r)€ (/;.)-/||oo< 



E 



.3 = 1 

(xii) for a = 5 and j3 = i 



||M r , £ (/;.)-/||oo< 



e; 



i=i 



2 2^75^7! 8 j 



i + i ^(|)r(i) i 
r(^)r(l) + 8. ? 



(18) 

^i(/',0. C>o, 

(19) 

ewi(/',o. £>o, 

(20) 
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(xiii) for a = 5 and j3 = I 



||M r , £ (/;-)-/||oo< 



e: 



i=i 



(xiv) for a = 5 and /? = jk 



|M r , £ (/;-)-/||oo< 



E 



(xv) for a = 5 and j3 = 1 



5jr(^)r(^) sr(i) i 

[r(^)] 2 [r(^)] 2 8 ^' 



j r(^)r(f) r(|)r(A) i 
2 r(^) + 2T(i) + 8, 



|M r , £ (/;-)-/||oo< 



e: 



i=i 



1 



H 3 ^ v^y-T^ h, 



(xvi) for a = 5 and f3 — 2 



(21) 
(22) 



(23) 



||M r , £ (/;-)-/||oo< 



E 



'^ 3 -^V r «> r «> ■ ' 



72 



9r(^)r(A) 8 j 



(24) 



Proof. We used [1], Theorem 9, (59). 

We present 

Theorem 4. Let n — 2 and a = 2. Here 

£ r , £ (/;z) = M r , c (/;x) - /(*) - r i Z) WMwf"fl I E^ 2 ] ^ 



2 r(^)r(/3-^) l£ 



Then 



(i) for 13 = 


. 3 

2 






-,e/lloo < 


v h l 


"2j A 

3 


HI 


L fe^[r(i)] 2 



2.7 



(ii) for /3 



t 2 wi(f",t),t>0, 

(25) 



l^r.c/11. 



< 



E 



2,/tF 



4^ 3[r(|)] : 



5i[r(i)] 2 is [r (|)] 2 5[r(i)] 2 j 



rwi(/",o,^>o, 

(26) 
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(iii) for /3 = 2 



\\Er,d\\oo < 

(iv) for 13 = 3 



E 



r\ 1 



i \JJ 72 



3^ | 8V2j 

j IT 



£V(/",£U>0, (27) 



|-Ev,j/||oo < 



£ 



J=l 



r\ 1 



J7 252 



15 



9^2 16v^j 



^V(/",0^>0, (28) 



(v) for p = f 



|-Ey,{/||oo < 



e; 



i=i 



j yir(f) y^r(|) 

6 + 8jT(i) + 4 r(i) 



rwi(/",O^>0. (29) 



Proof. We used [1], Theorem 9, (59). 

We give 

Theorem 5. Let n — 3 and a — 3. Here 

£ r , £ (/;z) = M r , c (/;x) - f(x) ^ wf I w« ~ f i ( E ^ ] ^ 



2 r(£)r(/?-£) l£ 



Then 

(i) for = 1 



IK € /||oo < 



E 



M / 3 +^+ 4 ^ 



96j 



£V(/"',£U>0, (30) 



(ii) for p 



\Er,£f\\oo < 






3y? + 2j(2 + j)r(|)r( 
" i6jr(J)r(|) 



rwi(/" , ,o.€>o, 



(iii) for /3 = | 



(31) 



|-EV,£/||oo < 



E 



9yi + 2j(2j + 5)r(§)r(|) 
64jT(i)r(i) 



£V(/'",£U>o, 

(32) 
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(iv) for p = I 



\Er,tf\\oo < 



E 

(v) for /3 = 2 

||£r,£/||oo < 



(3 + 4j)Vir(§) + 2j=»r(i)r(|) 
4 8ir(|) 



eV(/"',0^>o, 

(33) 



E 



16-/3- 



27 



12j 



1440 



CV(/'",6,e>0. (34) 



Proof. We used Theorem 9 of [1], (59). 

We also have 

Theorem 6. Let n = 4 and a = 4. Then 

(i) for /? = 1 



-Er,c/||oo < 

(ii) for = | 






(5 + 2V^j 2 + 5j esc (^)) sin 
240j 



£V(/ (4) ,£U>o, 

(35) 



ll^/||oc < 



^ \j) 480 



(hi) for /3 = 2 



4j + 5^2 



[r(|)] 2 , 2sin(^) ' 



£V(/ (4) ,£U>o, 

(36) 



ll^/lloo < 



3 = 1 V 



(iv) for /3 = | 



l-^r^/lloo < 



(v) for (3 



E 



(5 + ^ 2 + fjcsc(f)) 
420j 



eV(/ (4) ,o,e>o, 



5Vi + 2^(r(f)) 2 + 5 J T(|)r(i; 
90jT(|)r(|) 



(37) 

£V(/ (4) ,o,£>o, 

(38) 
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|-Ev,c/||oo < 



E 



5jr(f)r(g) + 2j'r(&)r(f) + 5Vir(§) 
50jr(|)r(^) 



£V(/ (4) ,0,£>o. 

(39) 



Proof. We used [1], Theorem 9, (59). 

We also have 

Theorem 7. Let n — 5 and a = 5. Then 

(i) for /? = 1 



IKC/Hoo < 



E 



(ii) for (3 = 2 



sinfL(i 5 + 4 J (-^ + ^, 



sin ^- sin : 



2880j 



eV(/ (5) ,o.e>o, 

(40) 



|-Ev,{/||oo < 



(iii) for /3 



E 



25 + 4 ^( 8 v / ^+(^- 1 )^) 

8640 (-y/5 + 1) j 



£V(/ (5) ,£U>o, 

(41) 



ll^/||oo < 



(iv) for /? 



E 



i5^r + 4i(ir(^)r(|)+3r(|)r(^)) 

1152jT(i)r(|) 



£V(/ (5) ,£U>o, 

(42) 



|-EV,{/||oo < 



(v) for (3 



E 



4;(;r(i)r(^) + 3r(f)r(ii)) + i5^r( 



672jr(i)r(^) 



£V(/ (5) ,£U>o, 



(43) 



|-Ev,{/||oo < 



E 



i=i 



(vi) for j3 — 



j . 5^r(A) +4j r(i)r( 

720 960jT(£)r(&) 



eV(/ (5) ,o,^>o, 

(44) 
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|^r,{/||oo < 



E 



15V5F + 4J(jT(^)r(§)+3T(f)r(g)) 



2880jr(i)r(f) 



£V(/ (5) ,£U>o. 

(45) 



Proof. We used [1], Theorem 9, (59). 

We further add 

Theorem 8. Let n = 1. Then 

(i) for a — 1 and /3 = 2 



||M r ,£/ - /floe < 

(ii) for a = 2 and /3 = 2 

r 

J =1 

(hi) for a = 2 and /3 = § 



E 



r A /'i , ! , ! 



J/ \2 7T 



^i(/',0^>0, (46) 



24j 



£wi(/',O,£>0, (47) 



h^W |[r(|)] 2 , 



^i(/',O,e>0, (48) 



(iv) for a — 2 and /3 = § 



||M r , € / - /Hoc < 



E 



r\ / 1 2^ 



2j 



; [r(i)] ; 



r?WV 8 ^' [r (i)]^ [r(i)]- 

Proof. We used [1], Corollary 4. 



ewi(/',o.e>o. 

(49) 



3 A Voronovskaya Type Theorem 

Let aj as in (5). 

Let / : R — > R be such that /(") exists and it is bounded and Lebesgue 
measurable. Also for x e R, £ > and a £ I, /J > ^ the Lebesgue singular 
integrals M r ^(f;x) as in (6). 



Next we present some Voronovskaya type results. 
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Theorem 9. Let / : R — > R be such that /( 5 -* exists, and is bounded and 
Lebcsgue measurable on R, and let £ — ► 0+, < 7 < 1. Then 
(i) for a = 1, /3 = 6, we have 

(ii) for a — 2, /3 = 3, we have 

M r£ (f ] x)-f(x)=f"(x) (E^' 2 ) ^ 2 +/ (4) W (E^' 4 ) |^ + °^ 7 )' 
(hi) for a — 3, /3 = 2, we have 



M r , ? (/;aO-/(z) = /''(aO^ (X>J 2 ) +/ (4) ^)|^ I E^' 4 ] +°(^ 7 )- 

Proof. We used Theorem 4 in [2], with n = 5. ■ 

Corollary 10.(n=3 case) Let / such that /^'exists and is bounded and 
Lebesgue measurable on R. Let £ — > 0+, < 7 < 1. Then 
i) for a = 1, /? = 4 we obtain 

M r , ? (/;x) - /(*) = ^^ ( E^J 2 ] + °(£ 3 ~ 7 )> (50) 



ii) for a = 2, /3 = 2 we obtain 

M r , 4 (/ ;a; ) - /(*) = ^^ I E«,i 2 ] + °(^ 7 )> (51) 

hi) for a = 3, /3 — 2 we obtain 

M r ,df;x)-f{x) = ^ef"{x) [JZ^f] +o(e- 1 ). (52) 

Proof. In Theorem 4 of [2] we place n — 3, and the corresponding values 
for a and /3. ■ 

Corollary ll.(n=4 case) Let / such that /^'exists and is bounded and 
Lebesgue measurable on R. Let £ — > 0+, < 7 < 1. Then 
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i) for a = 1, /3 = 5 we obtain 



^ 2 /"(-)(e^ 2 )+°(^ 7 )' 



M^w-m = VA ef{x) ( >:«/ 1 +o(e- f ), (53) 



ii) for a — 2, (3 — 3 we obtain 

Mr,£(/;aO-/(aO = ^ 2 r(aO (X>i 2 ) +°(^ 7 )' ( 54 ) 

iii) for a = 3, /? = 2 we obtain 

M r , £ (/; a:) -/(») = ^/"(s) (X>i 2 ) +°(^ 7 )- ( 55 ) 

Proof. In Theorem 4 of [2] we place n = 4, and the corresponding values 
for a and /3. I 

4 Higher Order Uniform Convergence with Rates 

Let a G N, j3 > ^-, and / : R — > R be Lebesgue measurable. We define for x G R, 
£ > the Lebesgue integral M r ^(f; x) as in (6) and assume that M r ^(f; x) G R 
for all z G R. 

Let / G C"(R), n G Z + with the rth modulus of smoothness finite, i.e. 

uj r (f (n \h) := sup ||AJ/< n >(aO||oo l!t < ex), h > 0, (56) 

|t|<h 



where 



Af/ (n) (aO : =E(-ir J '( . )/ (n) (a:+jt). (57) 

3=0 W 



We need to introduce 

r 

S k :=Y, a 3J k > k = l,...,neN. (58) 

Denote by |_-J the integral part. 

We present the Lipschitz type result corresponding to the Theorem 1 of [4] . 
Theorem 12. Let / be defined as above in this section, with n G N. Fur- 
thermore we assume the following Lipschitz condition: uj r (/ ( -™* > ,<5) < KS r ~ +7 , 
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K > 0, < 7 < 1, for any S > 0. For a € N, f3 > r ^ 2L , it holds that 



L«/2J 
M r ,iU\x)-f(x)- J2 



m—1 



f {2m \x) , 2m ^r(^±i)r(/3- 



2m+l' 
2a , 



r(^)r(/?-^) 



< 



KT( n + r)Y (^g) r (g - ^gg) 7 _ t _ 



r(n + 7 + r)r( 5 L)r(/3- 5 L) 

In L.H.S.(59) i/ie sum collapses when n = 1. 

Proof. As in the proof of Theorem 1, of [4], we get again that 



M r , € (/; x) - f{x) = X! ^^ W 



fc=i 



A-! 



2a \0 



-oo (fa _|_ f^ 



where 



n* n -.= w [°° n n (o,t)- — l — 



rdt. 



( t 2a + ^ 



and 



Also we get 



\3=0 



r m (\t\ -w)™- 1 , n 
\n n (o,t)\< im — ^_ Wr(/ («) ;U;)dw . 



Using the Lipschitz type condition we obtain 

/■l*l fl/l _ v ,) n - 1 

\n n (0,t)\< ^ >Kw r - 1+ ^dw 

Jo (n-l)! 

K\t\ n+r+1 ~ 2 /"'*' 



)n— 1 / \ r— 1+7 
y dw 



(n-l)! ,o 

T^UIn+r+7-l (-1 



K\t\ n+r+ f- 1 T(n)T('y + r) 
(n-l)! T(n + 7 + r)' 



(59) 



eft ]+K, (60) 



(61) 



^" (M) '■= [ { \^~{jr I E a // w (^i«')-y (n) w I *»■ (62) 



(63) 



(64) 



123 



and 



ANASTASSIOU, MEZEI: APPROXIMATION BY SINGULAR INTEGRALS 



\n* n \ < w 



K ^n+r+ 7 -i r(n)r( 7 + r) 1 

(n - 1)! T(n + 7 + r) U2 a + £2«\/3 

WKT(j + r) f°° \t\ n+r +i- 1 



(II 



r(n + 7 + r) J_ 00 ( t 2 a+ f^0 

2WKT(-f + r) f°° i" +r+7 - 1 



■dt 



r(n + 7 + r) J Q (t^ + f^f 

WKT( 7 + r)T (?gg) r (g - ggg) 
^_(„+ r+7 ) ar(n + 7 + r)r (/3) 

r(n + 7 + r)r(^)r(/3-^) 



-r 



We notice also that 

L«^J f(2m) (x) 



L«/2J 
Mr t(L {f\x)-f{x)- J2 



m— 1 



' (2m)! 

m— 1 v y 
/( 2 m)(x) 



x2m 



2aN/3 



(// 



(65) 



oo (*2a + £ 2 ") 



(2m) 



<$2m£ 



'r(^i)r(/3- 



2m+l ' 
2q / 



r(£)rC8-£) 



= 7?.* 

(66) 



By (65) and (66) we complete the proof of the theorem. 



We give 

Corollary 13. Let / be defined as above in this section. Furthermore we 
assume the following Lipschitz condition: w 2 (/', S) < KS 7 , K > 0, < 7 < 1, 
for any S > 0. T7ien 



\M 2>i (f;x)-f(x)\< 



K 

2(7 + 2) sin 



(3+7) . 



2+7 



(67) 



Proof. In Theorem 12 we used n = 1, a = 3, /3 = 1 and r = 2. 



For the case 



we have 



Theorem 14. Let / be defined as above in this section, with n — 0. Further- 
more we assume the following Lipschitz condition: oj r (f,S) < K5 r ~ 7 , K > 0, 
< 7 < 1, for any S > 0. For a e N, /? > ^2, it holds that 



\M r , i (f:x)-f(x)\< 



^^r^-^l^i 



r(£)r(/?-£) 



-i' 



(68) 
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Proof. As in the proof of Corollary 1, of [4], with n = 0, using the Lipschitz 
type condition, we get that 

\M rX (f;x)-f(x)\<2W [ w r (/,t)- 1 — -„dt 

<2W Kt r ~ 1+1 -At 

Jo (t^a + f^f 

/•oo ,r— 1+7 

= 2KW / T ,dt 

JO ( t 2« + f«) /3 

r(£)r(/9-£) c ■ 

This completes the proof of Theorem 14. ■ 

Corollary 15. Let / be defined as above in this section, with n = 0. 
Furthermore we assume the following Lipschitz condition: u) r (f,5) < KS 7 , 
K > 0, < 7 < 1, for any S > 0. Then 

\M 2ii {f;x)-f{x)\< , f C +1 - (69) 

Proof. In Theorem 14 we used a — 3, /3 — 1 and r = 2. ■ 

In the next we consider / <G C"(K), n > 2 even, a € N, /? > ^ and the 
simple smooth singular operator of symmetric convolution type 

M ? (/, xo) :=W ( f(x + y)- 1 -^-xdy, for all x e K, £ > 0. (70) 

That is 

M e (/; x ) = W f (/(xo + y) + /(.xo - y)) ^—3 dy, for all i„eR,(>0. 

Jo (j/ 2 "+? ) 

(71) 
We assume that / is such that 

Mz(f;x ) G R, Vx e M,V£ > and u 2 {f {n) ,h) < 00, /i > 0. 

Note that Mi ;€ = M € and if M € (/; a; ) G R then M r ^(/; x ) G R. 

Proposition 16. Assume u>2(f,h) < 00, /i > 0, a € N,/3 > -^-*- Further- 
more we assume the following Lipschitz condition: u>2 (f,S) < KS , if > 0, 
< 7 < 1, for any S > 0. ITien 

ii«, w -/iu< ^4)^.-^ ■ ™ 
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Proof. Using Proposition 1 of [4] we obtain 

\M i (f;x )-f(x )\<W [ w 2 {f,y)- l -^r^dy 

f°° Ky 1+ ~< 
< W / T Ay 

h ( y ^+e a f 

2r( 5 b)r(/3- 5 L) ' 

proving the claim of the proposition. 



(73) 



In particular we have 

Corollary 17. Assume u>2{f,h) < 00, h > 0. Furthermore we assume the 

following Lipschitz condition: uj 2 (f,S) < KS +7 , K > 0, < 7 < 1, for any 
5 > 0. Then 

U'W) - /|U < , fH C +1 - (74) 

4sm L( 4 H 

Proof. In Proposition 16 we used a = 2, = 1. ■ 

Let 
tf 2 (a:o): = M £ (/;a:o)-/(a:o) (75) 



"r(j 



; ' ' !: - ''" |X '' 2p+l 

2a 






We give 

Theorem 18. Let f £ C n (W), n even, M ? (/) real valued and a £ N, /3 > 
2 a . Furthermore we assume the following Lipschitz condition: 0J2 (f , $) < 
K8 1+ '\ K > 0, < 7 < 1, for any 6 > 0. Then 

KV (j+n+2\ p to _ 7+»+2 \ 
l^2(^0)| < ^ 2 "// V 2oJ r +7+l. (76) 

Proof. Using Theorem 6 of [4] we obtain 

\k 2 (x )\ < -w / « 2 (/ (n) ,y)- ^—77*/ 



n! /n ZW ""/..a,, , i-2a\^ 







(y 2 «+£ 2 T 



1 r^x 2 ^- 1 r^i +T _ y r ' 



" 1 V 2a ) L V^ 2a / t n+ 7 +l 



n!2r(£)r(0-£) 



r +7+ , (77) 
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proving the claim of the theorem. ■ 

In particular we have 

Corollary 19. Let f <G C 4 (IR) such that M^(f) is real valued. Furthermore 

we assume the following Lipschitz condition: L02 (/' , S) < K8 7 , K > 0, 
< 7 < 1, for any 6 > 0. Then 



i*.(*)i < ' T . + ?;^f 1 ^- 

288 sin [("4 ) 7rJ 
Proof. In Theorem 18 we used a — 2, ft — 2 and n = 4. 

We also give 

Corollary 20. Let / e C 2 (K), smc/i i/iat 

w 2 (/", |tf|) < 2A\y\\ 0< 7 <2, A > 0. 
Then for xq G R we have 



M i {f;x,)-f{x )- f '^e 



< 



2V2AT (2+?) T ( 



5—7 ■> 



J7+2 



3tt(7 + 1)( 7 + 2) 
Inequality (79) is sharp, namely it is attained at x = fry 



My) 



A\y 



7+2 



( 7 +l)(7 + 2) 

Proof. In Theorem 7 of [4] we used a — f3 — 2 and n = 2. 

We also give 

Corollary 21. Assume that u>2(f,£) < 00 and n = 0. Then 

||M U (/) - /Hoc < (2 + ^) W2 (/,0, 

and as £ — > 0, 

^2.5 — * -f with rates. 
Proof. By formula (37) of [4] with a = 2, f3 = 1 and r = 2. 

Let 



#1== 



L«/2J 

M r , £ (/; a) -/(&)- £ 



(78) 



(79) 



(80) 



2ro+l~ 



/ (2m) (*L ,2 m fr( 2 ^)r( / 3 an 

"2m? 



(2m) 



r(£)r(i8-£) 



(81) 
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We present 

Corollary 22. Assuming / € C 2 (R) and W2(/",£) < oo, ^ > we have 



K 1 = 



M 2i t(f;x)-f(x)-^P-5 2 e 



^K 1 + 7i)^ 2(/ "^ 



(82) 



That is as £ — > we get M2.5 — > /, pointwise with rates, given that H/"!!^ < 00. 
Proof. In Theorem 11 of [4] we used a = 3, ft = 1 and r = n = 2. ■ 

We also present 

Corollary 23. Assuming f € C 2 (M) and W2 (/",£) < oo ; £ > we have 



ll#2(aO|L 



M^/;^)-/^)-^ ^ 2 



^i(i + -L^ 2 «2(/".0- 



(83) 



TTiai zs as £ — > we get Mj — > I, pointwise with rates, given that H/"!!^ < 00. 
Proof. In Theorem 12 of [4] we used a = 3, (} = 1 and n — 2. ■ 



5 L p Convergence with Rates 

For r € N and n e Z + we let ay as in (5). 

Let / <= C n (R) and /<» e I P (M), 1 < p < 00, a e N, /3 > ^, we define for 
1 e M, ^ > the Lebesgue integral 



M r , £ (/;aO = W 






fit. 



(84) 



where the constant VF is defined as in (3). 

We need the rth L p -modulus of smoothness 

u r (f( n \h) p := sup \\A r t f (n) (x)\\ p . x , h>0, 

\t\<h 



where 



3=0 ^ 



(85) 



(86) 



Here we have that co r (f^ n ',h) p < 00, h > 0. 
We need to introduce 






(87) 
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We define 



L"/2J f(2m)( -.\r V ( 2m+l \ r (g 2m+l \ 



H ( 2 -)! r(£)r (/?-£) 



(88) 



the sum collapses for n — 0, 1. 

We have the following results. 

Theorem 24. Let n € N, a € N, (3 > — (| + ra + r) and t/ie rest as above. 
Then 



l|A(x)|| 2 < 
where 

<T 



(2a)*r(/9)*fV* 



r (£)* T (/J-£)*(2r + !)*[(" -l)i](2n-l)V2 



(1 + u) 



2r+l 



,2n-l 



jd« - 

(u 2a + if Jo (u 2a + 1) 



jdu 



-M/ (n) ,£) 2 , 

(89) 
< oo. (90) 



Hence as £ — > we obtain ||A(a;)||2 — > 0. 

If additionally /( 2m ) e L 2 (K),m = 1,2, . . . , [f J then ||M,, ? (/) - /|| 
as £ -► 0. 

Proof. In Theorem 1 of [3], we place p = q = 2. 



0, 



Corollary 25. Let (3 > (§ + r) and i/ie rest as above. Then 



||M r , € (/;.)-/|| 2 < 



£ V / 2TW 



7r A /(2r + l)r(/?-i) 



= Wr(/',0s 



where 
0<r 



(1 + W) o 

(u 2 + if 



du 



o {u 2 + 1)' : 



rdu 



Hence as £ — > we obtain \\M r ^(f; •) — /H2 — ► 0. 

Proof. In Theorem 1 of [3], we place p — q = 2, n — 1, a = 1. 

Corollary 26. Let / be as above in this section. Then 

||M 3 , ? (/;0-/|| 2 <^=^3(/',£)2, 
7v&7r 

w/iere 



0< r 



(1 + u) ^du— . 

{u 2 + lf Jo {u 2 + lf 



du 



< 00. 



(91) 



< 00. (92) 



(93) 



(94) 
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Hence as £ — > we obtain ||M 3 ^(/; •) — /|| 2 — ► 0. 

Proof. In Theorem 1 of [3], we place p = q = 2, n = 1, a = l,/3 = 5 and 
r = 3. ■ 



Corollary 27. Let f3 > \ (| + r) and tfte rest as above. Then 

l|A(x)|| 2 < 
wraere 



/ r(/3)r 2g 2 

3r(i)r(/3-i) v / 2r + l 



Wr(/",£)2, 



(95) 



0<r := 



,,3 /-oo 3 

/i , \2r+l u , / M 

(1 + u) ^aw- / 7T 

{u 4 + lf Jo (u* + lf 



fill 



< oo. (96) 



Hence as £ — > we obtain ||A(a;)|| 2 — * 0. 

If additionally /" e L 2 (ffi) then ||M r>4 (/) - /|| 2 -► 0, as £ -> 0. 

Proof. In Theorem 1 of [3], we place p = g = 2, n = 2, a = 2. 
Corollary 28. Let / be as above in this section. Then 



\\M^(f;x)-f(x) 

where 

0<r := 



/"(^ 2 r(|,)r(/3-A) 



65rT 



(i + «r 



2 r( 5 L)r( /3 -|) Cll ^V^24 W4(/ ''^ 

(97) 
du - / — T^wdu < oo. (98) 



(u 4 + 1) 



4.25 



I 4 i i\4.25 

(u 4 + 1) 



Hence as £ — > we obtain ||A(a:)|| 2 — > 0. 

If additionally /" e L 2 (R) then ||M 4j? (/) - /|| 2 -► 0, as £ -► 0. 

Proof. In Theorem 1 of [3], we place p = q = 2, n ~ 2,a = 2, f3 = 4.25 and 
r = 4. ■ 



Corollary 29. Let /3 > | (| + r) and i/ie rest as above. The 

^3 



l|A(x)|| 2 < 



6rr (/3) 



4 



5(2r + l)r(i)r(/3 



TYV^(/'",02, 



(99) 



where 

<T 



(1 + u) o 

(«« + if 



du — 



o (u 6 + if 



du 



< oo. (100) 



Hence as £ — > we obtain ||A(a;)|| 2 — > 0. 

If additionally /" e L 2 (K) then ||M r>? (/) - /|| 2 -► 0, as £ -► 0. 
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Proof. In Theorem 1 of [3], we place p — q = 2, n = 3, a = 3. 
Corollary 30. Let f be as above in this section. Then 



r(|) 



\\M 5 ,df;x) - f(x) - f(x)S 2 "'* rib < 



where 

<t := 



91t \ £> 
110 j 12 



W5(/'",02, (101) 



5 poo 5 

U , U 



(i + «) 

ii (u 6 + 1) 6 Jo (u 6 + 1) 



-^g-dU — 



Jg-dU 



<oo. (102) 



Hence as £ — > we obtain ||A(a;)|| 2 — > 0. 

If additionally /" e L 2 (R) then ||M 5;? (/) - /|| 2 -> 0, as £ -► 0. 

Proof. In Theorem 1 of [3], we place p = q = 2, n = 3, a = 3, = -§ and 
r = 5. 

Corollary 31. a G N, /3 > ^ (§ + r ) a^^ ^e res ^ fl s above. Then 



|A(x)|| 2 < 



2arr (/?) 



r 



7(2r + l)r(£)r(/5-£)6 



^(/ (4) ,C) 2 



(103) 



where 
0<r := 



(1 + u) ^ du — 

(u 2 « + if 



o (u 2q + If 



rC?U 



< oo. (104) 



Hence as £ — > we obtain ||A(a;)||2 — » 0. 

If additionally / (2m) G L 2 (M), m =1,2 then ||M r ,f (/) - /|| 2 -> 0, as £ -> 0. 

Proof. In Theorem 1 of [3], we place p = g = 2, n = 4. ■ 



Corollary 32. Let f be as above in this section. Then 

5V10634129t 



|A(x)|| 2 < 



786432 



-^ 6 (/ (4) ,?) 2 



(105) 



where 










<t := 


/ (1 + u) 81 du 

yo (u 8 + i)^ 


/ 8T^ U 

^0 ( U 8 + l)^ 


< OO. 


(106) 



Hence as £ — > we obtain ||A(a;)||2 — * 0. 

If additionally /( 2m ) G L 2 (R),m = 1, 2 then ||M 6;? (/) - /|| 2 -> 0, as £ -> 0. 

Proof. In Theorem 1 of [3], we place p — q = 2, n = 4, a = 4, /3 = ^ and 
r = 6. ■ 
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Corollary 33. Let f be as above in this section. Then 



(107) 



where 

0<T 



\15 W 



(1 + u) 

I) (w 10 + l) 10 



du 



o (u 10 + l) 10 



-du 



< oo. (108) 



Hence as £ — > we obtain ||A(x)||2 — > 0. 

If additionally /< 2ro ) e L 2 (K),w =1,2 then ||M U (/) - /|| 2 -> 0, as £ -> 0. 

Proof. In Theorem 1 of [3], we place p — q — 2, n = 4, a — 5, /? = fg and 
r = 7. ■ 



Next we present the Lipschitz type result corresponding to Theorem 1 of [3] . 
Theorem 34. Let p, q > 1 smc/i tfiai - + - = 1, n £ N, a e N, /? > 



max 



•^ — , 77- , " 1 > . and the rest as above. Furthermore we assume 

\ qa ' 2a ' a pa J ' 

ollowing Lipsch 
for any S > 0. TTien 



i/ie following Lipschitz condition: ui r (f^ n ',S) < K5 1 7 , K > 0, < 7 < 1, 



|A(a;)|| p < 



[r(/3)]r 



2/3 i_ 1 ? r 1 p( ?, - 1 +7+")+i A p 



2 2a 



2a 



nf )r(^)'r(/3-^)((n-i)!) 



p ( Pi _ p(r-l+7+n) + l \ p ^ 



-e 



r— l+7+n 



(g(n - 1) + 1) « ]p (r - 1 + 7) + 1] " 



(109) 



Hence as £ — > we obtain ||A(a;)||p — ► 0. 

If additionally /( 2m ) e L p (R),m = 1,2,..., [fj then \\ M rAf) ~ f\\ p - 0, 
as £ -> 0. 

Proof. As in the proof of Theorem 1, [3], we get again 



I •- 



r°° ( r°° ( r\t\ 

/ \A(x)\ p dx < ci / / . 

J-00 W-00 Wo 



uj r (f^, w y p dw) itr- 1 



{t^+e a ) pf3/2 

(110) 



(ft 



where 



r^-i a [rwr f -i)' 



Cl 



(f ) " r (£) r (/3 - ^) p ((„ - iy.) P (q(n i) + i)*/« 



(111) 
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Using the Lipschitz condition, we obtain 

Cl KP I f°° \ t \P (r - 1+ ^+^ 



(p (r - 1 + 7) + 1) !./_«, ( t 2a + ^a-j^/2 

2c\K p ( f°° tp( r - 1 +~<+ n ) 



di 



(II 



(p ( r - 1 + 7) + 1) W ( <2a + £2a)P/»/2 



(p (r - 1 + 7) + 1) W ( u 2a + X ) 



NP/3/2 



dw, 



' fc + i r 00 u fe r C^ti) r (x - ^±r 

it holds for fc > -1, a > 0, A > — — that / ^-du = ' : " -'" 



2a """Vo ( u 2« + i) A " 2ar(A) 

(112) 



fr(/3)i p r f ^ - 1 9 r f p( r ~ i +T+")+i ] p / m _ p(r-i+ 7 +n)+i \ ^ p ^( r _i+ 7 + ra ) 

r (f) 1+?r (2k) r (/ 3 -2kr(("- i ) ! ) p (^-i)+i)^b(^-i+7)+i] 



Thus we obtain 



P r q§_ M'r ^ p(r-l+7+") + l 



i< [rWrjf : ^p i *, 
>(¥) 1+f r(^)r(/3-^n ( n-i)!)p 

r fM _ P(r-l+l+n) + l \ j£p£p(r-l+~f+n) 

(q(n-l) + l)P/i\p(r-l + j) + l] 
That is finishing the proof of the theorem. 



(113) 



In particular we have 

Corollary 35. Let f such that the following Lipschitz condition holds: 
<^7 (f ( - 4) ,S) 2 < K8 G+1 , K > 0, < 7 < 1, for any S > 0, and the rest as above 
in this section. Then 



|A(X)|| 2 < - J T ^0 1 ) r ( 1 5^ 7+10, (114) 

1 V jl12 - 6Y 14(13 + 2 7 )r(i) ? V ' 
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Hence as £ — > we obtain ||A(x)||2 — * 0. 

If additionally /( 2m > e L 2 (R),m = 1, 2, then \\M 7A {f) ~ /ll 2 -^ 0, as £ ^ 0. 
Proof. In Theorem 34 we placed p = q = 2, n = 4, a — 5, f3 = f^ and 

r = 7. ■ 

Corollary 36. Let / such that the following Lipschitz condition holds: 
cj e (f ( - A \5) 2 < K5 5+1 , K > 0, < 7 < 1, for any <$ > 0, and the rest as above 
in this section. Then 



l|A(x)|| 2 < -J } 4 jM ,« V +9 - (H5) 

11 V 7 " - 6 y 7(ll + 2 7 )r(|)9!^ V ; 

Hence as £ — ► we obtain ||A(x)||2 — * 0. 

If additionally /< 2m ) e L 2 (M), m = 1, 2, then ||M 6)S (/) - /|| 2 -► 0, as £ -» 0. 

Proof. In Theorem 34 we placed p = q = 2, n = 4, a = 4, (3 = ^ and 
r = 6. I 

Theorem 37. Let f e C n (R) and /(") e Li(R),n e N, a € N, /3 > 1± ^ L . 
Furthermore we assume the following Lipschitz condition: uj r (f^ n \ S) < KS r ~ 7 , 
K > 0, < 7 < 1, for any S > 0. Then 

l|A(*)||i < < " \\ ", n w ;° TT ^ 1 . (116) 

(r + 7 )(n-l)!r(^)r(/3- ^) 

Hence as £ — > we obtain ||A(a;)||i — ► 0. 

If additionally /( 2m ) e Za(R),m = 1,2, . . . , |_f J then ||M r , ? (/) - /^ -» 0, 
as £ -> 0. 

Proof. As in the proof of Theorem 2, [3] we get 

» a (* s 5^iy, (£ (/"W</<»>, »m») ^^) ■ d") 

Consequently we have 

r°° / /■ 1*1 \ l/l™- 1 \ 



A(x)iu < 7 -^— r / (x^-^)d W -j*i 



(n-l)! \J_ 00 yj J (t 2a + f a f 

KW ( f°° /|tr +7 \ lil"" 1 ^ 



d,t 



, , , , ^di 

(n-l)! \J- co \r + 1 ) (fct+fcy 

KW ( f°° |£|n+H-7-l \ 



(r + 7) (n - 1)! yj^ ( £ 2« + ^ a y 
2KW ( f°° t"+ r+7 " 1 



(r + 7 )(n-l)! \J ( t 2a +f a f 



dt . (118) 



134 



ANASTASSIOU, MEZEI: APPROXIMATION BY SINGULAR INTEGRALS 



We have gotten so far 

IIAfVHN < 

(r + 7)(n-l)! 



AWII, < . 2K Z X .„ , <™> 



where 



/^oo j.n+r+7— 1 

A : = / — jjdi (120) 

/>oo /jin+r+7— 1 
= .n+r+ 7 -2a/3 / -y 

7 (r 2 « + 1/ 

p i" rt+r+7 \ p In _ n+r+7 \ 
_ c rt+r+7-2a,3 1 V 2a ^ X \' J la. ) 

C T (/?) 2a 

Hence the validity of (116). ■ 

Corollary 38. Let f G C 2 (M) and /" € _Li(M). Furthermore we assume the 
following Lipschitz condition: u> 2 {f",8) 1 < K8 +7 , K > 0, < 7 < 1, for any 
5 > 0. Then 

l|A(x)||i < ^r(|)r(^) 
" (2 + 7 )r(i) 2 

Hence as £ — > we obtain ||A(a;)||i — > 0. 

If additionally /" e L 1 (M),then ||M 2 , € (/) - /l^ -► 0, as £ -» 0. 

Proof. In Theorem 37 we placed n = 2, a = 2, /?=§ and r = 2. ■ 

Corollary 39. Let / € C 4 (R) and /( 4 ) <G Li(R). Furthermore we assume 
the following Lipschitz condition: 0J4 (/ ( - 4 - ) , 5) 1 < if (5 7 , AT > 0, < 7 < 1, for 
any 5 > 0. TTien 

||A(x)||i < Uo / ,r r +7 . (122) 

11 V Jl11 " (4 + 7 )6r(i) V ' 

Hence as £ — > we obtain ||A(x)||i — > 0. 

If additionally /( 2m ) e Li(R),m = 1, 2, then ||M 4 , ? (/) - /l^ -»• 0, as £ -» 0. 
Proof. In Theorem 37 we placed n = 4, a = 5, /3=j^ and r = 4. ■ 

In general, when n — we get 

Proposition 40. Let r <G {1,2} and the rest as above. Then 

2\ 4 /4~t 1 

\\MrAf) - /lb < jr7iy^ 5 wr(/, O2, (123) 

w/iere 

f 00 1 

0<6:= (l + t) 2r -- 73/2* <°°- I 124 ) 

Jo (£ 4 + 1) 3/2 

Hence as £ — > we obtain M r ^ — ► unit operator 7 in the L 2 norm. 
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Proof. In the proof of Proposition 1 of [3] we used p = 2,q = 2,a = 2, (3 = 



We also have 

Proposition 41. Let r <G {1,2, ...,9} and the rest as above. Then 



||M r , £ (/)-/|| 4 < 



13 


[r(ir 


3 
4 


[rf-V 


i 

4 


[r( 


'13Y 


2 


k(f)_ 




L w_ 




l 


v^JJ 



^'w r (/,04, (125) 



w/ie 



0<6» 



OO -I 

(l + t) 4r dt <00 . 

(i6 + l) 19/3 



(126) 



Hence as £ — > we obtain M r £ — ► unit operator I in the L4 norm. 

Proof. In the proof of Proposition 1 of [3] we used p = 4, q ~ |,a = 3, /3 



f,re{l,2,...,9}. 



We continue with 

Proposition 42. Letp,q> I such that ± + \ =l,a€N, ) 9>max{^,i,^d + i} 

and i/ie resi as above. Furthermore we assume the following Lipschitz condition: 
uj r (/, 5) p < i« r ~ 1+7 , K > 0, < 7 < 1, for any 6 > 0. TTien 



||M r , £ (/)-/|| p < 



ky (/3)r(f-±yr ( {r - 1 t2 )p+1 ) ' r ^ - ^ ' --- , '- ' ■ V : 



r(^r(M,)rf'r 



-i 



0-1+7) 



Hence as £ — > we obtain M r .£ — > unit operator / in the L p norm, p > 1. 
Proof. As in the proof of Proposition 1 of [3] we find 



(127) 



f 

J — ( 



\M r , i (f:x)-f(x)fdx 
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•'■ ' «r(/,t)5- — -r-^* 



r(^)r(/3-^rr(f) f 


/ 

Jo 


2ar /3p - 1 [r(/3)fr(f -±f 


/■OO 

/ / 


r(^)r(/3-^rr(f) f 


io ( 


^P2a[r(/3)] p e (r_1+7)p r(f - 


2a J 



(t 2a + £ 



'- ^ : ^ ^- / {Kf-^) p l — dt (128) 

/ — [ R7^ dT ( 12 9) 

r(£)r(*-£)'r($V ^ (^ + 1^ 
r(^)r(/?-^rr(f)*r(f 

We have established the claim of the Proposition. ■ 

Corollary 43. Let f such that the following Lipschitz condition holds: 
0J4 (/, 6)2 < K6 7 , K > 0, < 7 < 1, for any <5 > 0, and the rest as above in 
this section. Then 



\\M 4ii (f) f\\ 2 < J \°nwin } Kf + \ (130) 



r(!)r(f) 

Hence as £ — > we obtain M4 ^ — » unit operator 7 in the L2 norm. 

3 

2 



Proof. In Proposition 42 we place p = 2, g = 2, a = 4, /?=§ and r = 4. 



Corollary 44. Let / suc/l £/ia£ i/ie following Lipschitz condition holds: 
<^2 (f, S)^ < K6 7 , if > 0, < 7 < 1, for any S > 0, and i/ie resi as above in 
this section. Then 



\\M 2 ,df) - fh < 



-p (3\ 3 r ( 5+4 7 \ r f 7-4 7 \ 

, Uj M 4 / M 4 } 2K^£+\ (131) 

N r (i)° 2 



Hence as £ — + we obtain Af2,g - ► unit operator J in the L4 norm. 

Proof. In Proposition 42 we place p = 4, g = 4/3, a = 2, /3 = | and r = 2. 



In general, in Li case, n = we have 
Proposition 45. For r € {1,2,3} it holds 



IM-,*/ -/||!< fjf 



(l + t) r ^.dt)u r (f,0i- (132) 

(t 4 + l) ¥ / 
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Hence as £ — > we get M r ^ —> I in the L\ norm. 

Proof. In the proof of Proposition 2 of [3] we used a = 2, j5 — |. ■ 

Proposition 46. For r £ {1, 2, ..., 5} it holds 

l|M r , 5 / -/||!< ( f°(l + i) r ^-rdt ) w P (/,Oi- (133) 

Hence as £ — > we gei M r ^ —^ I in the L\ norm. 

Proof. In the proof of Proposition 2 of [3] we used a = 3, /3 = g. ■ 

Proposition 47. Assume (3 > ^p-. Furthermore we suppose the following 
Lipschitz condition: u) r (fjS)-^ < KS 7 ~ , K > 0, < 7 < 1, for any (5 > 0. 
Then 

l|M r , 5 / - /ik < r ffi J r( ]f_^V 1+T . (134) 

Hence as £ — > we get M r ^ -^ I in the L\ norm. 
Proof. As in the proof of Proposition 2 of [3] we get 

\M r ,t{f;x)-f(x)\dx<W f « r (/,|t|)i- ^-3* 

J-00 (i 2c "+£ 2a ) 



oc 



<vk/ ^|tr- i+7 — - — T At 
J -00 (t^+e a Y 

/•oo j.r— 1+7 

= 2KW / - T ,dt 

= K , . „ 7 =— r- / ^CU 



r(£)r08-£)./o (T^ + r/ 3 

£ r ~ 1+7 - (135) 



«r ffi) r (/3 - ^) ^.i^ 



r(^)r(/3-^) 

We have proved the claim of the proposition. ■ 

Corollary 48. Assume the following Lipschitz condition: w 2 (/, 5) x < 
K5 1+1 , K > 0, < 7 < 1, for any 5 > 0. Then 



Hence as £ — ► we get -M^j — > I in the L\ norm. 

Proof. In Proposition 47 we place a = 3, (3 = 1 and r = 2. 
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In the next we consider / € C™(R) and /(") <G L p (R), n — or n > 2 even, 
1 < p < oo and the similar smooth singular operator of symmetric convolution 
type 



M i {f-x) = W f(x + y) 



1 



(y 2a +C 



rdy, for aU x G K, £ > 0. (137) 



Denote 

"/2 f (2p)/ rl r (2p+lN p ,o _ 2p+l^ 

p= 
the sum collapses for n = 0. 



fe ( 2 p) ! r(£)r (/?-£) 



(138) 



We give 

Theorem 49. Let n <G {2,4,6} anrf the rest as above. Then 



\K(x)\\ 2 < 



663 



1 



2(2n-l)64(n- 1)! 



r 1/2 r^2(/ (n) ,02, (139) 



whe 



(140) 



I / \ 1 
0<f=/ ((l + uf-lju 2 "- 1 ^du<oo. 

Jo v y (l + u 4 )~ 

Hence as £ — > we get \\K(x)\\2 — > 0. 

If additionally /( 2m ) G ^(M),™ = 1,2,..., f then ||M £ (/) - /|| 2 -> 0, as 

£ - o. 

Proof. In the proof of Theorem 3 of [3] we used a = 2, (3 = ^,p = 2, g = 2. ■ 
Theorem 50. Let n <G {2,4,6,8, 10} and the rest as above. Then 



\K(x)\\ 4 < 



' r(fp y r(f) 

, 2r (f)/ 2x/3(4n-l) S r(|)'(n-l)! 



whe 



< f 



((i+^-iW- 1 — - 

" ' (1 + u 6 



f 1 /Vw 2 (/ ( " ) ,04, 

(141) 
r du < oo. (142) 



(1 + M 6) 25 / 3 

Hence as £ — > we get ||if(x)||4 — + 0. 

If additionally /( 2m ) G L 4 (R),m = 1,2,..., f then ||M ? (/) - /|| 4 -» 0, as 

£ - o. 

Proof. In the proof of Theorem 3 of [3] we used a = 3,/3 = ^,p = 4, gr = 4/3. 
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It follows a Lipschitz type approximation result. 

Theorem 51. Let p, q > 1 such that - + - = 1, n> 2 even, a € N, 

fi > " +7+ — h — and the rest as above. Furthermore we assume the following 
Lipschitz condition: uj 2 (f (n \S) < KS 7+1 , K > 0, < 7 < 1, for any S > 
0. Then 

||if(x)|| p < [ _ v 2 2 ^I v 2 JL / il _ 2a - / 

'^ " [( 7 + l)p+l]^2[(n-l)!]r( 5 L)"r(/3- 5 L)r(f)'r(f) l ( g (n-l) + l)i 

(143) 
Hence as £ — » we ge£ ||-ftT(a;)||p — > 0. 

If additionally /( 2m ) e £ p (K),m = 1,2, . . . , f then ||M e (/) - /|| -> 0, as 

Proof. As in the proof of Theorem 3, of [3] we find 



(7+l)P+l WO ( y 2« + £2 Q )P/3/2 
^P c £(7+l+™)p+l / /-°o y( 7 +l+n)p 



:dT 



[(7 + 1) P + 1] C PP \Jo (T 2 « + l) pf3/2 j 

KPC2 ^ + ^ 1 r (g±ggg) r (f - MHgMi) 
[(7 + i)p + i]r p02 « " r(f) 



^ P [r (/3)fr ( f - f ) r ( (7+1 £ )p+1 ) r ( f - (7+1 £ )p+1 ) e (7+1+n)p 



[( 7 + i)p + i]2f+ 1 r(^)r(/3-^) p r(f) P/ V(f)[(n-i)!F( g (n-i) + i)pA 

(144) 
where here we denoted 

rro9)] p a£ aA,-1 rf*2-^ v ' " 



c 2 := ^ ^ . (145) 

2f r (£) r (/3 - ^) P r (f ) P q [(n - l)!] p («(n - 1) + l)*/« 

We have established the claim of the theorem. ■ 
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Corollary 52. Assume the following Lipschitz condition: u>2(f",o~) 2 < 
K5 1+ , K > 0, < 7 < 1, for any 5 > 0, and the rest as above in this 
section. Then 



\K(x)\\ 2 < 



'Lmim^+3. 



5 (27 + 3) 7T 

Hence as £ — > we get ||if(a;)||2 — * 0. 

If additionally /" e L 2 (K), then ||M € (/) - /|| 2 -► 0, as £ -► 0. 
Proof. In Theorem 51 we place p — 2, q = 2, a = 3, /3 = 2, and n = 2 



(146) 



Corollary 53. Assume the following Lipschitz condition: 0J2 (/ >o)a ^ 
i^T(5 7+1 , if > 0, < 7 < 1, for any S > 0, and the rest as above in this 
section. Then 



\\K(x)\U < 



00 



■ 15-47 ' 

40tt (4 7 + 5) 



(147) 



Hence as £ — > we get ||if(a;)||4 — > 0. 

If additionally /< 2m ) e L 4 (M),m = 1, 2 then ||M C (/) - /|| 4 -> 0, as £ -► 0. 

Proof. In Theorem 51 we place p = 4, g=|,a = 3, /3 = 3, and n = 4. 



Theorem 54. Let / e C 2 (M) and /" e Li(R). ffere K(x) = M^f-x) 

2 



/» - 2/"(x; 
ll^)lli< 



Ki) 

r(i) 



6(r(|)r 



f\ T/ien 



12 r 



12VtF 



0. 



Hence as £ — ► we obtain \\K(x)\\\ 

Also ||M € (/) - /Hi - 0, as £ - 0. 
Proof. In the proof of Theorem 4 of [3] we used a = 2, /3 = |, n = 2. 

Theorem 55. Let / e C 6 (M) and /( 6 ) e Li(R). Then 



^2(/",£)lf. 

(148) 



(149) 



Hence as £ — > we obtain \\K(x)\\\ — » 0. 

If additionally /< 2m ) e Li(R),m = 1,2,3 then ||M|(/) - /l^ -> 0, as £ -> 0. 
Proof. In the proof of Theorem 4 of [3] we used a — 3, /3 = 2, n = 6. ■ 



The Lipschitz case of p — 1 follows. 

Theorem 56. Let f e C"(R) and /(") e Li(R), n > 2 even, a € 
N, /3 > y . Furthermore we assume the following Lipschitz condition: 
^2 (f (n \S) 1 < K5 1+1 , K > 0, <7 < 1, for any S > 0. Then 



KrC 1+n+2 )r(B 
l^(*)lli< 2 " 



7+k+2 ^ ^7+ri+l 
2a 



r 



(n-l)!2( 7 + 2)r( 5 L)r(/3- 5 L) 



(150) 
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Hence as £ — > we obtain \\K(x)\\i — » 0. 

If additionally f {2m ^ € L 1 (R),m = 1,2,..., § then ||M £ (/) - /||j -> 0, as 

Proof. As in the proof of Theorem 4 of [3] we have 

s " , r(U'( jrrM )*)(^5i^r^)* 

da; 



(n-l)!(7 + 2) 7o (a; 2 « + lf 



(n- 1)1(7 + 2) 2a T (/3) 

kl (3*^) r (/? - ld ^ ±? ) C +n+1 



~ (n-l)!2( 7 + 2)r(i)r(/3-^) 
We have proved the claim of the theorem. 



(151) 



Corollary 57. Lei / <G C 6 (IR) and j^ 6 -* S Li(M). Furthermore we assume 
the following Lipschitz condition: 102 (j**- , S) < _ftT(5 7 , if > 0, < 7 < 1, for 
any 5 > 0. TTien 

^(7 + 4)7^2 +7 

l|K(XJI11 - 10080( 7 + 2)sinY ? ' l J 

Hence as £ — ► we obtain \\K(x)\\i — ► 0. 

If additionally /< 2m ) e Li(R),m = 1,2,3 then ||M C (/) - /||j -> 0, as £ -► 0. 
Proof. In Theorem 56 we place a = 2, j3 = 3, and n = 6. ■ 

The case of n = follows. 

Proposition 58. Let / as above in this section. Then 

||M 4 (/)-/|| 2 < Vl5+_8^ ^ (/ ^ )2 _ (153) 

Hence as £ — > we obtain M^ — > / m £/ie L2 norm. 

Proof. In the proof of Proposition 3 of [3] we used p = 2,^ = 2,Q! = 3, /3 = 1.B 

The related Lipschitz case for n = comes next. 

Proposition 59. Lef p, g > 1 such that 1 + 1 = 1, a e N, j3 > max { ^, ^±2 + ^ } 
and ifte resi as above. Furthermore we assume the following Lipschitz condition: 
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^2 (/, S) p < /« 1+7 , K > 0, < 7 < 1, for any 8 > 0. Then 

II^(/)-/IIp < [ — , ,* , ,* " ■ 

2r(^)^r(/3-^)r(f) 5 r(f) p 

(154) 
Hence as £ — > we obtain M^ —> I in the L p norm, p > 1. 

Proof. As in the proof of Proposition 3 of [3] we get 

[rwar^rff -t) v/q r i 

|m,(/;x)-/(x)r.x< ^ — t^tJ ^(f,y) p p - v^m d v 

,p/q 






p/<? L ^2q i 1 ^p/ 2 



2?r(^)r( /3 - 5 Lrr(f) P/9 ■>» C^ + D 



2? +1 r(^)r(/3-^r(f) P/9 r(f 

The proof of the claim is now completed. I 

A particular example follows 

Corollary 60. Let f as above in this section. Furthermore we assume the 
following Lipschitz condition: u>2 (f,^) 2 < KS 7 , K > 0, < 7 < 1, for any 
5 > 0. Then 

j r ( 3+2 7 \ p f 5-2 7 \ 

||M ? (/) -f\\ 2 < K^j { 4 ^ 4 V +7 - (156) 

Hence as £ — > we obtain M^ — > 7 m t/ie L2 norm. 

Proof. In Proposition 59 we place p = <j = a: = /3 = 2. ■ 

Also we give 
Proposition 61. It /ioZgLs 

||M £ /-/|| 1 <^t9 W2 (/,0i- (157) 

Hence as £ — » we ge£ M^ —^ I in the L\ norm. 

Proof. In the proof of Proposition 4 of [3] we used a = 3, /3 = 1. ■ 
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It follows the Lipschitz type result 

Proposition 62. Assume the following Lipschitz condition: u>2(f,S) 1 < 
K6~ f+1 , K > 0, < 7 < 1, for any 5 > 0. For a e N, [3 > ^, it holds, 

\\Mtf -f\\i< Vtx / Me +1 - (158) 

Hence as £ — > we ge£ M^ ■—> I in the L\ norm. 
Proof. As in the proof of Proposition 4 of [3] we derive 

\M s (f;x)-f(x)\dx<W [ w 2 (/,y)i- ^-^di/ 

Jo (y 2 " + e ) 

f 00 1 

<WM i<7/ 7+1 ^rfy 



r (/3) airc 7+1 r 00 r +1 



r di 



-£ 7+1 - (159) 



KT(^)T(p-^) cJ+1 



2T(^)r(/3-^) 



We have established the claim. 



In particular, we have 

Corollary 63. Assume the following Lipschitz condition: u>2 (/, $)-± < K5~ , 
if > 0, < 7 < 1, for any S > O.It holds 

K ^„„(7 + 2)vr^ 7+1 



Wtf-fh < - I csc^^ )T +1 . (160) 



Hence as £ — > we </ei M^ —> I in the L\ norm. 
Proof. In Proposition 62 we place a = 3,/3 = 1. 
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Abstract 

In recent years, chaotic analysis methods have been used for studying the 
physiological systems and developing contributions for making a medical 
decision. In this study, snore sounds have been analyzed using chaotic methods, 
such as embedding dimension, average mutual information (AMI) and the largest 
Lyapunov exponent (LLE). The LLE calculation as an indicator of chaos is 
performed to investigate the disturbance of snore sound in normal and 
apnea/hypopnea diseases. The results show that the LLE of normal snore group 
have been found significantly higher than apnea/hypopnea group (P<0.05). It is 
concluded from experimental results that the LLE, as a chaotic analysis method, 
is a useful tool for determining the chaotic behaviour of snore sounds and can be 
used for diagnosis of these diseases. 

Keywords: Nonlinear analysis, OSAH, Snore analysis 

1. Introduction 



Obstructive sleep apnea/hypopnea (OSAH) is characterized by repetitive 
obstruction of the upper airways during sleep. OSAH is general example of a 
treatable disease, which is not suddenly life threatening. However, it may cause a 
range of complications such as a reduction in cognitive function, cardiovascular 
disease and fatigue [1, 2]. Many researchers have studied to analyze snoring 
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sounds associated with OSAH using different techniques such as sound intensity 
calculations, power spectrum estimation and counting of snores in a related time 
interval [1, 3-5]. These studies showed that snoring carries information on 
obstructive sleep apnea (OSA). In recent years, three studies have been published 
to classify snore sounds into snore/non-snore [6-8]. Duckitt et al [2006] 
presented a method which allows the automatic monitoring of snoring 
characteristic, depending on intensity and frequency of data [6]. They used Mel 
frequency cepstral coefficients (MFCCs) as the features in a hidden Markov 
model (HMM) based classification. Cavusoglu et al [2007] estimated sound 
energy, zero crossing and using linear regression for classification [7]. The other 
method used feature of sounds such as number of zero-crossings, energy, 
normalized autocorrelation coefficients, and first predictor coefficient of linear 
predictive coding (LPC) analysis for classification of snore sounds [8]. 

Recently, there are many studies which applied chaotic methods to the 
physiological signal for detecting some diseases [9-11]. The snore sounds have 
time varying characteristics, did not be analyzed by chaotic analysis methods in 
the previous studies. Differently from these studies, we have investigated the 
chaotic dynamics of snore related sound, using chaotic measures such as 
embedding dimension, average mutual information (AMI) and the largest 
Lyapunov exponent (LLE). The LLE is the most commonly used method in 
nonlinear analysis of physiological signals as a chaotic indicator. In this study, 
the sounds have been reconstructed in the phase space after determining the 
embedding dimension and time delay, and then the LLE calculations have been 
performed for normal and apnea/hypopnea cases. The student's t test has been 
applied to the results obtained from these analyses. 

2. Material and Methods 
2.1. Snore data and segmentation 

In this study, we used the same data which is [7], obtained from Gulhane 
Military Medical Science Sleep Laboratory. The database contains 20 patients, 
12 OSAH patients, age is between 44 and 62, 8 normal snores, age is between 40 
and 54. The details about this database are referred to [7]. While working these 
data, 34 segments were chosen for feature extraction and analyzing illnesses. 
These segments consist of 17 normal sleep states, and 17 apnea/hypopnea 
problems' states. 

Snore sounds are segmented as described in [12] and shown in Fig.l. 
Abeyratne et al [2007] classified raw data into three classes such as silence, 
unvoiced non-silence and voiced non-silence [12]. Fig. 1 shows how snore sound 
segments belonging to these classes are combined to form snoring and breathing 
episodes. Voiced and unvoiced segments were used in our study. 
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Partial Snore Sound 



Ci. 6 
0.4 
CI. 2 

D 



m>p 




Figure 1 . Segmentation of a snore sound 



2.2. Methods 



2.2.1. Nonlinear analysis 

There are many methods such as Lyapunov exponents, correlation dimension, 
poincare plots, Kolmogorov entropy etc. used as chaotic measures [13, 14]. To 
estimate the chaotic measures of a system, the phase space of system has to be 
reconstructed from the time series data [13]. The nonlinear measures of the 
system are calculated from this reconstructed attractor [13]. In this work, snore 
related sounds were reconstructed by using Takens' embedding theorem in the 
m-dimensional phase space with delay t as [15]: 



X 



\ X i-> X i+r-> X i+2r 



,X 



(+3r »" 



S'+(m-l) 



r) 



(1) 



where, X t is the ith point on the attractor (i = N-(m-l)r), x(i) is the ith value of 

snore data, m is phase space dimension, t is time delay. We used AMI function 
for t selection. The proper x is the first minimum value of AMI function 
according to [16]. The phase space dimension, is called as embedding dimension 
(m), has to be m>2D+\ (D is the attractor' s dimension), but attractor dimension 
is not known in advance [13]. There are several methods for choosing the 
embedding dimension [13, 17, 18]. We used m chosen from false nearest 
neighborhood (FNN) method [17]. 

2.2.2. The largest Lyapunov exponent (LLE) 

The Lyapunov exponent is defined as a quantitative measure of the sensitive 
dependence to the initial conditions. The value of Lyapunov exponent increases 
with the degree of chaos. In the system embedded in the m dimensional phase 
space, the number of Lyapunov exponents is equal to the number of phase space 
dimension. Each exponent gives the long-term average divergence ( /t, > ) or 
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convergence (/I, <0) rate along the related axis in the phase space [13, 19]. 
Hence, Lyapunov spectrum will be arranged such that A l >A 2 >....> X m , the 
largest value ( \ ) is called as LLE. Since a positive Lyapunov exponent 
indicates chaos, if the LLE of the system is positive ( X\ > ), the system is 
chaotic [13, 19]. Therefore, the estimation of the LLE is sufficient and a 
common technique to determine the presence of chaotic behavior. There are 
several algorithms for calculating of the LLE from time series signal [19-22]. In 
this study, Rosenstein et al [22] 's algorithm has been used. This method is based 
on estimating the average local divergence rate, can work short and noisily time 
series. 

According to Rosenstein et al [22], after reconstructing the system's attractor 
and the lyapunov exponents are given as 

i i ¥=?, dj(i) 

\(i) = / ln — (2) 

1(0 iAt M-i4i dAO) 



./=! 



dj(0) 



where At is the sampling period of the time series, and d, (i) is the distance 
between the j pair of nearest neighbors after i discrete-time steps, M is the 

number of reconstructed points, and (/,(;') « C e ' ' ' ' . Cj is initial separation. 

By taking the logarithm of both sides of this equation, 
ln d j (i) » ln C , + A l (iAt) is obtained. It represents a set of approximately 

parallel lines (for j = 1,2, ...,M), each with a slope roughly proportional to %i. The 
largest Lyapunov exponent is easily and accurately calculated using a least- 
squares fit to the "average" line defined by 

y(i) = -^(\ndj(i)) (3) 

where, (...) denotes the average over all values of/ [22]. 

2.2.3. Statistical analysis 

Statistical analysis was performed by using the unpaired student-t test. The 
normality tests were applied to the data groups prior to statistical tests and it was 
seen that they had normal distribution. The level of significance was selected as 
PO.05. 

3. Results and Discussion 

The time delay (x) and embedding dimension (m) were determined for 
reconstruction of the snore segments, x measured as the number of samples was 
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found as first minimum of AMI function [13, 16]. The AMI function of a normal 
snore segment (SN: 2) is shown in Figure 2a. The optimal x was chosen as 6 for 
this segment. The x values obtained from normal and apnea/hypopnea segments 
were not statistically different (normal snore segments: 7.18±1.85, 
apnea/hypopnea segments: 7.88±2.52 (P=0.375)). The optimal embedding 
dimension was found to be 5 according to FNN method [17] for the same 
segment, is given in Figure 2b. The embedding dimensions of normal and 
apnea/hypopnea segments have commonly found to be close to 5 in experiments 
(normal group:4.12±0.33, apnea/hypopnea group:4.06±0.56 (P=0. 71)). Therefore, 
for the LLE calculation, embedding dimension was set to 5 for all segments. 




10 15 20 

Time delay (sample) 
(a) 




5 10 

Embedding dimension (m) 
(b) 



15 



Figure 2. Determination of time delay (a) and embedding dimension (b) for a 
normal snore segment 

The results obtained from LLE analysis for each normal and apnea/hypopnea 
segments are given in Table 1. According to unpaired student-t test result and 
Table 1, mean LLE value of normal group is higher than apnea/hypopnea group, 
significantly (P=0.0071). If the results taking into account, we can say that, 
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unlike the embedding dimension and time delay measures, the LLE measures are 
successful for classifying these segments. 

Table 1 . The estimated LLE values for normal and apnea/hypopnae snore 

segments 



Segment No 


Normal snore 
group 


Segment No 


Apnea/hypopnea 
group 


1 


0.0862 


18 


0.0690 


2 


0.0593 


19 


0.0659 


3 


0.0429 


20 


0.0479 


4 


0.0405 


21 


0.0362 


5 


0.0283 


22 


0.0171 


6 


0.0211 


23 


0.0609 


7 


0.1618 


24 


0.0115 


8 


0.0643 


25 


0.0295 


9 


0.1855 


26 


0.0347 


10 


0.0395 


27 


0.0433 


11 


0.0932 


28 


0.0268 


12 


0.0718 


29 


0.0115 


13 


0.0690 


30 


0.0122 


14 


0.0853 


31 


0.0106 


15 


0.0343 


32 


0.0311 


16 


0.0225 


33 


0.0473 


17 


0.0343 


34 


0.0271 


MeaniSD 


0.0671±0.046* 




0.0343±0.019* 



P=0.0071 

4. Conclusions 

In this study, LLE analysis of snore related sounds which are obtained from 
normal and apnea/hypopnea snore segments have been performed by using the 
algorithm of Rosenstein et al [22]. The results have shown that LLE is 
significantly lower for apnea/hypopnea group than normal. Namely, the LLE 
decreases with the apnea/hypopnea disorders. This decrement of the LLE in the 
cases of apnea/hypopnea indicate that dynamics of snore sound have low level 
chaotic behaviour with respect to normal case. 

Consequently, LLE calculation gives useful information for diagnosing the 
apnea/hypopnea diseases. In future, snore sounds may be analyzed by using 
other chaotic measures. These analysis results can be used in classification 
studies for apnea detection. 
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Abstract 

In this study, the chaotic indicators of penicillin-induced epileptiform activity in 
comparison with basal brain activity were calculated in anesthetized Wistar rats. 
Male Wistar rats were anesthetized with i.p. urethane and connected to an 
electrocorticogram setup. After a short period of basal activity recording, 
epileptic focus was induced by injecting 400 IU/2 jal penicillin-G potassium into 
the left lateral ventricle while the cortical activity was continuously recorded. 
Basal activity, latent period and the penicillin-induced epileptiform activity 
periods were selected and analyzed using both the largest Lyapunov exponent 
(LLE) and correlation dimension (CD) techniques. Results suggest a marked 
decrease in signal predictability and increased chaotic behavior during the 
generation of epileptiform spikes, which is generally in accordance with various 
human studies performed previously. Those preliminary results may be 
interpreted as a proof for the similar dynamics of experimental and clinical 
epilepsy. 

Keywords: Electrocorticogram, Penicillin-induced epileptiform activity, Chaos, 
Nonlinear analysis, Time series analysis 

1. Introduction 

Chaotic analysis techniques have been frequently used in the analysis of non- 
stationary physiological signals [1]. There are some studies which are analyzed 
epileptic brain signals by using chaotic analysis methods [2-6]. The correlation 
dimension (CD), autocorrelation and largest Lyapunov exponent (LLE) 
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calculations were performed on the human EEG and it is found that epileptic 
EEG has a low dimensional chaotic behavior [2]. In the study made for children 
subjects with epilepsy and epilepticus during slow-wave sleep, the evidence of 
nonlinear dynamics was found for all EEG signals [3]. The predictive power of 
Lyapunov exponent was studied and it is said that usage of Lyapunov exponents 
practically impossible to predict epileptic seizures and EcoG signals more 
chaotic than low dimensional chaotic systems [4]. Despite of this result, Yambe 
et al [2005] stated that epileptic seizures can be predicted by using chaotic 
analysis methods. Kannathal et al [2005] examined the epileptic human EEG 
using the LLE, CD, Hurst exponent and entropy measures and found that LLE of 
epileptic group was higher and CD of epileptic group was lower than control. 

Such analysis may also provide important insights about the nature of 
complex physiological phenomena, such as the generation of epileptic 
syndromes. Signal complexity and predictability measurements may show some 
different aspects of electrophysiological signals compared to traditional analysis 
methods. In the present study we analyzed penicillin-induced epileptiform 
activity recorded from rat brain after intracortical penicillin injection. 

2. Material and Methods 

Animals and experimental procedure 

Four months old male Wistar rats weighing 198±13.05 g were used in this study. 
Animals were kept in heat-regulated rooms, on a 12-h day/12-h night cycle, and 
given as much food and water as needed. All experimental procedures were 
carried out according to the guidelines of European Community Council for 
experimental animal care. 

Animals were anesthetized with urethane (1.2 g/kg; i.p.) and the scalp 
covering the skull has been cut with a rostro-caudal incision of 3 — 4 cm long. 
Skull bone covering the left upper surface of the brain was removed by gradual 
thinning with a dental drill. After complete removal of the left side of the skull, 
dura mater was removed using micro scissors and the animal was fixed on a 
stereotaxic instrument (Harvard, USA). Body temperatures of the animals were 
continuously monitored and kept constant at a temperature of 37±0.5 °C using a 
homoeothermic blanket system throughout the study (Harvard Homoeothermic 
Blanket System). 

Two Ag — AgCl ball electrodes were placed over the left somatomotor cortex 
(electrode coordinates: first electrode; 2mm lateral to sagittal suture and 1mm 
anterior to bregma; second electrode; 2mm lateral to sagittal suture 5mm 
posterior to bregma). Electrodes were connected to a digital data-acquisition 
system (Powerlab/4SP, AD Instruments, Australia) and electrocorticograms 
(ECoGs) were recorded digitally to a computer hard drive using 1 kHz sampling 
resolution and 0.1 — 100 Hz filter. In order to induce an epileptic focus, each 
animal was received an intracerebroventricular (i.e. v.) injection of crystallized 
penicillin-G potassium (400 IU/21) using a Hamilton microinjector through an 
injection point located 1.5mm anterior, 2mm lateral to the Bregma, with a depth 
of 4.2mm located on the left somatomotor cortex [7]. This injection causes 
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generalized epileptiform activity characterized by large amplitude, spike, spike- 
wave and burst-like discharges in the recorded EEG or ECoG [8, 9]. 

Recording data 

All ECoG data were continuously recorded (by 200 Hz sampling rate) on a 
personal computer's hard drive through a data acquisition software (Chart 4.0.1, 
AD Instruments) and subsequent analysis of the ECoG data were performed 
offline. Online calculation channel recordings (including the spike amplitude and 
frequency calculations) were also performed during the experiments to monitor 
the severity of the epileptiform waves. At the end of the experiments, the 
position of the cannula was visually confirmed by 2% methylene blue infusion 
through the i.e. v. cannula after the animals sacrificed by cervical dislocation 
under anesthesia. Recorded ECoG data were visually assessed offline. Three 
distinct episodes were analyzed for each subject using nonlinear analysis 
methods and for analysis, three minutes of continuous and noise-free segments 
of each episode were selected. 

1. Basal brain activity under urethane anesthesia (Fig. la). 

2. Latent (silent) period which immediately follows the i.e. v. penicillin-G 
injection (the period in which the large amplitude ECoG components were 
significantly reduced; Fig. lb). 

3. Episode of mature epileptiform spikes (generally begins 15 — 30 min after 
the penicillin-G injection; Fig. lc). 




80 100 

Time (s) 



Figure 1 . The ECoG signals obtained from a intracotically anesthetized rat for 
basal activity (a), latent period (b) and epileptic activity (c) (subject no:l). 



Nonlinear analysis 

For estimating the chaotic indicators of a system, the phase space of the system 
has to be reconstructed from the variable [10]. An attractor is a set of states to 
which a dynamical system converges. The nonlinear measures of the system are 
calculated on this attractor [10, 11]. The Lyapunov exponent is a quantitative 
measure of the sensitive dependence to the initial conditions and a positive 
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Lyapunov exponent is accepted as an indicator of the chaos [10-12]. Another 
property of chaotic systems is that their attractor has fractal dimension. The CD 
is a measure of the complexity of a system [10]. 

In this work time -delay embedding method is used for reconstruction of 
brain signals [13]. The ECoG signal is reconstructed in the m dimensional phase 
space with delay coordinate T by using Takens' embedding theorem as: 

X i - (Xj,X jT ,X j+2 T ,X j+3T ,..., X, + ( m _l)r ) (1) 

where, X t is the ith point on the attractor (i = N-(m-l)T), x(i) is the ith value of 

the time series, m is the phase space dimension, T is the time delay. In this study, 
T is selected as the first minimum value of the average mutual information [10, 
11,14]. 

Largest Lyapunov exponent (LLE) 

The Lyapunov exponent X gives predictability of system. The number of 
Lyapunov exponents is equal to the number of dimension of the phase space. 
Each exponent gives the long-term average divergence (^i>0) or convergence 
(ki<0) rate along the related axis in the phase space. Since a chaotic system has 
at least one positive Lyapunov exponent, if the largest Lyapunov exponent 
(LLE) of the system is positive, the system is chaotic [10]. 

In this study, the Wolfs method was applied to the epileptic brain signals to 
estimate the LLE [13]. This algorithm is based on the direct calculation of 
divergence or convergence of the trajectories on the attractor. There is an 
Euclidean distance, 5x(0), at the t , between the two nearest points on the 
reconstructed attractor. At a later time t, 5x(0) initial distance will be evolved to 
distance 5x(t). The ratio of these two distances gives the evolution of these two 
points on the attractor for this time interval (t-t ) as given in Eqs. (3). This 
procedure is repeated by selecting the new data points on the attractor until the 
end of data. The LLE is defined as the average growth rate [13]. 

A(i) = lim -log ,y ' (3) 

«»r &c,.(0) 



Correlation dimension (CD) 

In this study, The CD was examined to characterize the system's complex 
behaviour. The CD gives the minimum number of independent variables 
necessary to generate the dynamics of a dynamic system [10, 15]. The CD was 
estimated using the Grassberger-Procaccia algorithm [15] and given as: 
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1 N 
C (r) = lim V ®(r - \\x i - X Jl) (4) 

Where, X, -X, is calculated as Euclidean norm and ©(»)is the Heaviside 
function. The correlation integral C(r) is estimated for the range of r. The CD is 
the slope of the linear scaling region of the plot of In C(r) versus ln(r) and is 
defined as: 

r->o In r 

The slopes (D2) are calculated by using the least squares fit and plotted as a 
function of m. These D2 values go to saturation for as increasing m and this 
value was taken as the CD of the system. In the CD calculation, the embedding 
dimension was set to 20 for all signals. 

Statistical analysis 

The results obtained from LLE and CD analysis for control, basal activity, latent 
period and epileptic activity of brain signals were expressed as mean±SD. The 
paired and unpaired student-t tests were used for statistical analysis after 
normality test. p<0.05 was accepted as statistically significant. 

3. Results 

The time delay and embedding dimension are determined for reconstruction of 
the ECoG signals. The time delay has been estimated using the average mutual 
information function. The embedding dimension is set to 5 for LLE calculation 

The 36,000 data points which are equal to 3 -minute time window were used 
to reconstruct the dynamics of ECoG signals for each activity. In Fig. 2, 
reconstructed ECoG signals obtained from a intracotically anesthetized rats for 
basal, latent period and epileptic brain activities were shown in a, b, c 
respectively (Subject No:l (left column) and Subject No:2 (right column)). In 
Fig. 2, the embedding dimension was selected as 3. The attractor of epileptic 
brain activity was different others as seen in below. 

In the LLE analysis, the exponential evolution of the phase space trajectories 
has been found by calculating the differences between the point pairs. Fig. 3 
shows the LLE computed for three different activities ECoG signals recorded 
from a intracotically anesthetized rat (Subject No:l). 

The brain signals have also been processed for the CD analysis. The D2 
values were plotted as a function of embedding dimension and go to saturation 
for as increasing embedding dimension m from 1 to 20. As shown in Fig. 4, the 
CD of basal activity, latent period and epileptic activity was obtained as 11.280, 
9.806, 7.515 respectively. 
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Figure 2 The attractors in the three dimensional phase space for (a) basal activity 
(b) latent period (c) epileptic activity. 



'V 5 ^** 
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■ latent period 
- epileptic activity 



LLEepilep tic: 0.1640 



LLEbasal: 0.116 



LLEIatent: 0.0439 



1000 2000 3000 4000 5000 5000 

Iteration 

Figure 3 Time evolution of the LLE estimated from basal activity, latent period 
and epileptic activity signals. 

The results obtained from LLE and CD calculations for control, basal 
activity, latent period and epileptic activity were expressed as means±SD in 
Table 1. After the normality tests, the paired student-t test was applied to 
compare the chaotic measures of these different groups. For comparing control 
and basal activity data, unpaired student-t test was used. 
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5 10 15 

Embedding dimension (m) 



Figure 4 The CD estimation for three different activities (subject no:l). 



Table 1 The LLE and CD values (meant standart deviation) of ECoG signals. 
Control Group Basal Activity Latent Period Epileptic Activity 



LLE 0.0023±0.00083 0.088±0.041 



0.034±0.038 



0.177±0.047 



P=0.001 a P=0.007 b P=0.012 c P=0.00017 d 



CD 



9.003±1.950 



11.43±1.673 



10.684±1.090 



7.167±1.014 



P=0.053 a P=0.48 b P=0.001 c P=0.0003 d 



Student-t test P value between a: control group and basal activity, b: latent period and basal activity, 
c: epileptic activity and basal activity, d: epileptic activity and latent period. 

According to results given in Table 1, the LLE for three groups were found 
statistically higher than control. The LLE of ECoG signals significantly 
increased in basal period compared to control. In the epileptic case, increment of 
the LLE is found quite high. The CD values for control, basal and latent periods 
were found higher than epilepsy, significantly. CD increased in basal activity by 
reason of anaesthesia and decreased in latent period if it is compared to basal 
activity, by induced penicillin. 

4. Discussion 

Penicillin-induced epileptiform activity is a widely used experimental model. 
This model is also suitable for analysis of spread of seizure activity and accepted 
as a model of simple aprtial (focal) seizures [16]. Thus, investigating the results 
of such a model with new approaches may provide new insights, especially by 
comparing new results with the previous findings on this particular model. This 
study has been designed as an introductory attempt for such a comparison. 

Some previous studies have provided evidence that epileptic seizures are 
nonlinear chaotic processes [17]. The most prominent result among our findings 
is the increased LLE through the epileptiform spike generation during the 
penicillin-induced epilepsy. The increase in LLE represents a more chaotic 
behavior in epileptiform activity compared to basal brain activity and the silent 
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period just before the spike onset. Increased chaotic behavior or decreased 
predictability of the signal suggest that there are more neural driving forces 
generating epileptiform activity than the ones which drive normal basal brain 
activity. Although the apparent shape and the rhythm of the epileptiform spikes 
seem rather regular, there is an increased complexity and unpredictability during 
the epileptiform area, as suggested by LLE estimations. The reason and the 
mechanism of this behavioral change should be investigated further. The LLE 
values obtained from silent period appears to be significantly lower than the 
epileptiform period, suggesting that this period is more predictable and less 
chaotic. It is however unclear from our findings that how this predictable activity 
becomes more and more chaotic when the epileptiform spikes begin. 

There is also a marked difference in CD values between different episodes. 
Through the generation of epileptiform spikes, CD values decreasing and reach 
their lowest value when the epileptiform activity begins. This finding, together 
with the LLE values, suggests a lower dimensional chaotic activity when 
compared to basal and silent brain activity episodes. 

There is some evidence on the increased chaotic behavior during the 
epileptogenesis obtained from human studies (REF) although some other studies 
indicate otherwise [17]. In the light of such previous findings, our results also 
suggest that the nature of penicillin-induced epileptiform activity might be 
similar to some epileptic disorders in humans. After further investigations, such 
analysis may also help to justify such pharmacologically-induced epilepsy 
models as a tool for the study of clinical epileptic disorders. A common ground 
between different findings on the chaotic behavior during epileptogenesis is the 
fact that the epilepsy, or epileptiform activity possess different dynamical 
properties compared to normal or interictal electrophysiological behavior [17]. 

In the current literature, analysis of penicillin-induced epileptiform activity 
was carried out mostly with conventional signal analysis approaches, primarily 
by spike -counting or spectral measurements [as an example, see ref. 18]. 
Analysis used in our study lead us to think that such nonlinear analysis methods 
can be used in the analysis of such signals obtained from conventional 
experimental methods in order to gain a better understanding of the underlying 
mechanism of electrophysiological phenomena. Among those parameters, 
especially LLE can be used as an indicator of chaotic behavior. 
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Abstract 

In this paper, we examine the chaotic operation of an optoelectronic circuit based on a single 
optocoupling device. The complete circuit is very simple and its software simulated operation 
demonstrates how chaos can be generated through external triggering at first, and then, how this 
chaos can be controlled by varying specific circuit parameters. The analysis of the obtained chaotic 
time series includes calculation of the optimal delay time as well as estimation of the minimum 
embedding dimension with the method of False Nearest Neighbors. 

Keywords: Chaos, Optoelectronic Circuit, Time Series Analysis. 



1. Description of the circuit 

There is a growing interest for non-autonomous chaotic signal generation circuits. Such a 
circuit may be externally driven and it can typically consist of only one active and a few passive 
components. Here, we consider a particularly simple circuit based on a single optocoupling device. 
Its complete layout is shown in Fig. 1 and it consists of a 4N25 optocoupler in a typical common 
emitter configuration along with an emitter degeneration resistor R 2 =3.3KX2, a collector resistor 
R=33Q, and a DC power supply V S s=12V. 

The circuit is driven by an input sinusoidal voltage u M (t) with amplitude Vj n =13V and 
frequency f=800 Hz, which is applied through an inductor L=lmH connected in series to the driver 
LED and a resistor Ri, the value of which, as we will see, plays a crucial role in the circuit's 
operation and the generation of chaotic voltage time series across Ri and R 2 . In this respect, we use 
the MultiSim circuit simulation software in order to examine the complete circuit operation by 
monitoring the voltages u D (t) and u E (t) across Ri and R 2 , respectively. 




Figure 1 : The considered optocoupling circuit and its MultiSim simulation environment. 

At this point, we must note that the considered circuit layout resembles the resistor-inductor- 
diode (RLD) and the resistor-inductor-transistor (RLT) circuits, whose chaotic operation details 
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have been presented and discussed in [l]-[5]. More specifically, following the conclusions derived 
in [l]-[3], we use various values for R ; in order to achieve chaotic operation in both - if possible - 
the input LED loop and the emitter output loop, i.e. across Ri and R2, respectively. Then, as 
already mentioned the simulated circuit operation is monitored by checking the voltages Un(t), 
across Ri, and u E (t), across R 2 , since both of these voltage signals depend on the chosen value of 
the LED resistor R D . 



2. Simulation results 

For the considered circuit operation simulation, we use u IN (t)=V in sin(27ift) with V in =13 volts 
and f=800 Hz. It is known that, chaotic operation may be generated under various operation 
conditions and parameters' values. In this work, we choose to keep V^ and f constant, while 
varying the value of Rj. Our goal is to first examine whether chaos can be achieve for a specific Ri 
value and then to examine whether variation of that value Ri may strengthen, weaken, or even 
destroy the achieved chaos, by returning the circuit to its typically expected operation. 

Under these conditions and after some try-and-error selections for the value of Ri, we 
conclude that if Ri is set equal to 5Q then the circuit will exhibit a fully chaotic operation, 
meaning that both voltage signals x>o(t) across Ri, and UE(t) across R2, are chaotic. This is readily 
shown in Fig. 2. Then, using this as a starting point, we see that an increase of Ri weakens the 
already obtained chaotic signals, and this continues up to a value of Ri=500Q, for which a weak 
chaotic signal can still be seen across Ri, but not across R2. This is shown in Fig.3. Finally, further 
increase of Ri leads to the total destruction of the remaining chaotic signal across Ri. This is 
shown in Fig. 4 in which, for Rj=lKQ, both voltage signals u D (t) and u E (t). 




(a) (b) 

Figure 2: For R[=5f2: both voltage signals (a), u D (t) across Ri, and (b), u E (t) across R 2 , are chaotic. 
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Figure 3: For R!=500£2: (a) D D (t) is a weak chaotic signal across R l5 and (b), v E (t) across R 2 is non chaotic. 
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Figure 4: For R^l KX2: both voltage signals (a), tj D (t) across R l5 and (b), tj E (t) across R 2 , are non chaotic. 



3. Nonlinear analysis 

In this section, we proceed to the analysis of the obtained chaotic signals time series when 
Ri=5£I Using our data, with value of Rj=5Q we construct a vector X-, j=l..N, where JV=5000 data 
values in the m dimensional phase space given in the following form, [4]: 



Xj — {Vi,Vi. z ,Vi.2 T ,---,Di + ( m .i) T } 



(1) 



This vector, represents a point of the m dimensional phase space in which the attractor is 
embedded each time, where x is the time delay x=iAt and zf^=0.1p.s is the sample rate. The element 
Vt represents a value of the examined scalar time series in time, i.e. here a voltage value u. across 
Ri or R2, corresponding to the i-th component of the time series. The use of this method reduces 
phase space reconstruction to a problem of proper determination of suitable values of m and x. The 
choice of these values is not always simple, especially when there is no additional information 
about the original system and the only source of data is a simple sequence of scalar values as 
acquired from that system. 

The dimension, where a time delay reconstruction of the phase space provides for the 
necessary number of coordinates to unfold the dynamics from overlaps on itself caused by 
projection is called embedding dimension m. Using the average mutual information, we can then 
obtain x as being less associated with a linear point of view, and, thus, more suitable for dealing 
with nonlinear problems. The average mutual information I(x), [6], expresses the amount of 
information (in bits), which may be extracted from the value in time 0, about the value in time v i+z . 
As x, suitable for the phase space reconstruction, the position of the first minimum ofI(x) is usually 
used [6]. In this case x =77 time steps for chaotic signal across emitter resistor R 2 and x=38 steps 
for chaotic signal across LED resistor Ri as shown in Fig. 5. 



20 



80 100 



(a) (b) 

Figure 5: Mutual information / versus time delay x for both chaotic signals across R[=5f2 (a) and R 2 (b). 
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Next, we use the method of False Nearest Neighbors (FNN), [6]-[7], in order to estimate the 
minimum embedding dimension. This method is based on the fact that when the embedding 
dimension is too small, the trajectory in the phase space will cross itself. Hence, if we are in 
position to detect these crossings, we may decide whether the used m is large enough for correct 
reconstruction of the original phase space (i.e. when no intersections occur) or not. If, however, 
intersections are present for a given m, then the embedding dimension must be considered too 
small and it must be increased by one at least. Then, again, we test the eventual presence of self- 
crossings. 

The practical realization of the described method is based on testing the neighboring points in 
the m-dimensional phase space. Typically, we take a certain amount of points in the phase space 
and find the nearest neighbor to each of them. Then we compute distances for all these pairs and 
also their distances in (m+l)-dimensional phase space. The rate of these distances is given by 



xim+l)-X t Am+\) 



(2) 



H4-KM 



where z ; (m) represents the reconstructed vector as described in (1), belonging to the i-th point in 

the m-dimensional phase space and index n(i) denotes the nearest neighbor to the z'-th point. Iff is 
greater than some value P max , we call this pair of points false nearest neighbors (i.e. neighbors, 
which arise from trajectory self-intersection and not from the closeness in the original phase space. 
The dimension m will then be found when the false nearest neighbors percentage falls below some 
limit, typically set to 1%, [8]. Thus, by choosing P max =10, we finally calculate the quantity m. The 
so obtained results are shown in Fig. 6 indicating that the application of the FNN method yields a 
minimum embedding equal to value 5 for both chaotic signals. 



£ 0.6- 



(a) 



(b) 



Figure 6: False nearest neighbor ratio as a function of the embedding dimension. The false nearest neighbors 
become negligible after m = 5 for the chaotic signals (a) across LED resistor R[=5f2 and (b) across 
emitter resistor R 2 . 



4. Conclusion 

In this work, the obtained simulation results indicate that a simple externally triggered 
optoelectronic circuit can be used in order first to generate chaotic voltage signals and then to 
control the obtained chaotic signals by varying specific circuit parameters, for example, the value 
of a specific component. In the considered optoelectronic circuit, the crucial parameter is the input 
loop resistor R b the value of which leads to the generation of a chaotic voltage signal UdO) across 
the resistor Rj. However, this chaotic voltage reflects a chaotic current through Ri and, thus, 
through the optocoupler's input driving LED. Hence, the so driven phototransistor will generate a 
chaotic voltage signal UeO) across emitter resistor R 2 , according to the strength of the driving 
chaotic light signal as controlled by the value of the input loop resistor Rj. 
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Specialized solutions of the Maxwell Bloch equations using subsidiary condi- 
tions are known to give predator prey like systems [1]. It is also known that the 
Maxwell Bloch system can be related to the Lorenz system. Both the predator 
prey system and specialized integrals of the Lorenz system can give solutions 
that can describe the relatively stable operation of lasers. We also investigate 
the consequences of modifying the self coupling in the resulting equations to 
a logistic map type self coupling and the interaction coupling to the form x k y 
[1, 2, 3]. Both generalizations lack structural stability, but have locally sta- 
ble structures. Results of the linearized stability analysis are given for both 
generalizations [4, 5, 6]. 
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1 Introduction 

The Maxwell Bloch model (henceforth referred to as MB) is an interesting sys- 
tem that models the operation of an atomic system resonantly coupled to the 
laser field. There have been several attempts to relate laser dynamical mod- 
els to predator prey models of the Lotka Volterra type, (henceforth referred to 
as LV), since predator models have oscillatory solutions that explain vertical 
Hopf bifurcation in laser models. The MB model under study involves E as the 
field amplitude coupling to the collective atomic polarization P. A represents 
population inversion with its initial value A . The model is described by the 
following equations [7, 9, 12]. 



E = -kE + gP (1) 

P = - 1± P + gEA (2) 

A = -7||(A-A )-4gtP.E. (3) 

Special solutions to the MB system that make either of the two nonlinear 
terms proportional to the third have been studied [7, 8, 9]. They are suitable 
candidates for stable behavior, since the third variable gets an exponentially 
decaying solution. 

The MB equations can be transformed into the system proposed by [9, 10, 
11], that resembles the LV problem with / representing the intensity of the laser 
field and N denoting population density. The dimcnsionlcss rate equations of / 
and N are obtained by assuming / = E 2 and multiplying the first MB equation 
(1) by E which gives 

EE = -kE 2 + gPE. 

Using the subsidiary condition gP = kEA, the second MB equation (2) is 
obtained as follows 

g 2 P 

The subsidiary condition for the Polarization equation enables decoupling 
and solving for the polarization as 

P = Poexp[-(7 ± -^-)*]. 

Finally we transform the MB equation (3) into 

A = -7|| (A - A ) - 4fcP 2 A. 

The MB model given above can be cast into the form of a predator prey 
equation by defining the intensity and population density as A = N, 2kt = t 
and 7= 2/ 7 [7, 8, 9, 10]. 
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/ = {-1 + N)I 
N = -y(Ao-N-NI). (4) 

Wc have successfully transformed the MB system into a new form that re- 
semble the LV equations by assuming Ao = and 7 < in the physical region 
[7, 8, 9, 11]. Thus the population fluctuations in the laser system can emulate 
a predator prey system governed by the pumping and lasing actions when the 
coupling 7 is negative where we get a pair of purely imaginary eigenvalues. Here 
equilibrium points are (0,0), (1,-1) and linearized eigenvalues are { — 1,-7}, 
{■y/7, — V7J- We see that these type of lasers naturally exhibit damped intensity 
oscillations that satisfy a degenerate form of the LV equations [8, 10, 11]. LV 
equations appear as an underlying problem and allow us to describe the bifurca- 
tion type that has been also analytically verified in the original system [8, 10, 12]. 

For the special case Ao — of equation (4) , which physically means an ini- 
tially empty population inversion, the system has the following LV like integral: 

log N — N — 7 log / — 7 I = constant 

Furthermore, if 7 = —1 then eigenvalues of this system become {—i, i} where 
the system resembles the LV model with Hopf bifurcation [8, 9, 10, 12]. Two 
generalizations of this model will be investigated here. One involves the simplest 
polynomial generalization by the addition of a quadratic term (6) to the self 
coupling which changes it from a Malthus like unstable term to a logistic map 
like term. The other involves generalizing the coupling from a simple product 
form, xy to the more general x k y form [10] . The comparison to the Lorenz model 
is also of interest, since under special conditions, it possesses first integrals that 
point to conditions under which chaotic behavior is absent. 

2 Connection with the Lorenz Model and Its In- 
tegrable Cases 

The relation between this model and the Lorenz model: 

x = a(y — x) 

y = —rx — y — xz 

z = xy — j3z (5) 

was first given by Khanin[6]. For k — a, j± = j- = 1, g 2 -^ = r, 711 = (3, 
the system can be transformed into the Lorenz system about the equilibrium 
point A = A by setting x — E, y = ^-, z = A — A. Here, a,r,0 are the 
Lorenz parameters. Since the MB equations have more parameters than the 
Lorenz system, some ambiguities do occur, for example the condition 4fc = 1 
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((3,a,r) 


Firstlntegrals 


(2k,k,A ) 


h = [E 2 - 2fc(A - A )) exp(2kt) 


(l,fc,0) 


h= (E 2 + (f) 2 ) exp(2t) 


(1,1, A ) 


J 3 =(-A E 2 + (^) 2 + (A - A ) 2 ) exp(2t) 


(6fc-2,fc,2fc- 1) 


-(4k - 2)E(f) - ^ + E 2 (A - A )) exp(Akt) 


(0,|,A ) 


7 5 =(A E 2 + |(f) 2 + \E<£ 

+E 2 (A-A )-lE*)exp(lt) 


(4,1,A ) 


J 6 =(4(A - 1)(A - A ) -A E 2 - (f ) 2 + 2£(f ) 
-£ 2 (A - A ) + ±£ 4 ) exp(4i) 



Tabic 1 : Integrals of MB System related to Lorenz system 



can be used instead of k = a, for physical reasons we will use the first set of 
conditions. Under these circumstances the known first integrals of the Lorenz 
system [7, 8, 9, 13] for special cases gives the first integrals in the Table (1) for 
the MB system [12, 13]. Parameter requirements for the first three integrals 
and the sixth integral are moderately reasonable. 



3 Adding quadratic term to the LV model 
related to the MB system 

Models such as Malthus and Verhulst are single species models. Many of the 
most interesting dynamical systems have complex interactions between species. 
Hence mathematical models that include both these single species coupling and 
coupling interactions are required to simulate these dynamics. The addition of 
a quadratic self coupling suggested by the Verhulst model produces the simplest 
polynomial generalization depending on the coefficient between the linear and 
quadratic term. Rescaling the variables and the parameters enables us to make 
the coefficient of the quadratic term unity without loss of generality. This 
generalization can introduce one or two stable equilibrium points for appropriate 
values of the modified parameters that belong to the following system where x 
plays the role of I = E 2 and y plays the role of N: 



For c : 



x = a(x — x ) — bxy 
y = -c(y + y 2 ) + dxy. 

b + d, this system has the following integral: 



(6) 



x Cl y C2 {l -x + y) 



(7) 
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where c\, ci are given expressions involving the equation parameters and pro- 
vided that ac+ bd y^ 0. 

Two additional equilibrium points are introduced into the system where 
the predator species consume one type of prey species represented by equation 
(6). The equilibrium points arc (0, 0), (1, 0), (£g£, =^y>) and (0,-1). The 
linearized eigenvalues associated with the equilibrium point (0, 0) are {a, — c} 
that becomes a saddle node, the eigenvalues associated with the equilibrium 
point (1, 0) are {—a, — c + d}. If d > c this equilibrium becomes a saddle node 
or a stable equilibrium, the eigenvalues associated with the equilibrium point 
( ac+bd ' ac+bd ) are a complex conjugates pair with complex conjugates eigen- 
vectors. If 

a 2 c + abc — ac 2 + acd 

-2(ac + bd) ~ 

then the equilibrium becomes stable and finally the eigenvalues associated with 
the equilibrium point (0, —1) are {a + b, c}. This equilibrium is unstable. Hence, 
this generalization can introduce one or two stable equilibrium points in the 
linearized approximation for appropriate values of the parameters. 

4 Generalization involving x k y coupling 

A different generalization can be obtained by introducing the nonlincarity x k y 
in the prey equation together with a quadratic term. The predator equation is 
LV. For a given value of the number k we define the following family of systems 
of differential equations. The specialized choice of parameters is dictated by 
the requirement that the system be compatible with a resonant normal form for 
integer values of the folding parameter a. The system is 

x = (a- l)x - x 2 - xy - a~ k+1 x k y 

V = -y + xy (8) 

and the following Lemmas apply 3.1, 3.2 are obtained; 

Lemma 3.1: The general form of equilibrium points of the system given above 

are (o — 1, 0) and (1, 1+ °~fc+i ) for all k. In addition to these points the system 

acquires one more equilibrium point at the origin if k > 2. 

Lemma 3.2: The system in concern has three saddle points whose linearized 

eigenvalues are {— 1, a — 1}, {1 — a, a — 2} and a third set of eigenvalues which 

start out as a saddle point for a < 2, degenerate into a sink and eventually into 

a stable focus for values of a ~ 2.3, the value is relatively insensitive to the value 

of k as long as k > 2. 

The general form of equilibrium points of the system (8) are (0, 0) for k > 2, 
(a — 1,0) and (1, 1+ °-fc+i ) for all k. Two of these are saddle points whose 
linearized eigenvalues arc {-1, a - 1}, {1 - a, a - 2}. If -Sa+a^-yfc+A ig 
defined as A then the eigenvalues of the k dependent equilibrium point are 
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v/-4(-2 + a)(a + a k ) 2 + {a k + a(3 - 2k) + a 2 (-l + k)) 2 
2(a + a k ) ' 

They imply that the equilibrium point starts out as a saddle point for a < 2, 
degenerate into a sink and eventually into a stable focus for values of a ~ 2.3, 
the value is relatively insensitive to the value of k as long as k > 2. 

By the change of variables x = rcosO and y — rsinO the following result 
which shows that there exists an infinite a family of periodic orbits near the 
parameter value a — 2 due to the crudity of the approximation independently 
of k [7, 8, 9, 13] . 



xx + yy = (a - l)x 2 - x 3 - x 2 y - a k+1 x k+1 y - y 2 + xy 2 (9) 

^ = (a/2-l)p 2 . (10) 

In order to understand this behavior, we pass to a rotating frame using 
x = u{t) cos cot + v(t) sinwi and y = —u(t) sinwi + v(t) cos tut, where u(t) and 
v(t) are slowly varying functions. We can then average the system over a full 
period < t < — . For k = 2 this yields the following system 

u = ( 1)m — lov — 

x 2 ' 

* = { 2- 1)v+UJU+ ^ + r a - (11) 

It is clear that for a — 2, the quadratic nonlinearity is the predominant one. 
In particular, if k = 2, a family of periodic solutions are available, nonlinear 
terms persist. If k = 3 the same behavior occurs, but nonlinear terms do not 
persist. This explains both the behavior at a = 2 and the insensitivity of the 
results to the value of A; [7, 8, 9, 13] . 

5 Conclusion 

The MB model exhibits chaotic behavior in a wide range if its parameter space 
[7, 8, 9]. For realistic models of lasers, chaotic behavior is undesirable. The aim 
of this work is to look at these cases. One possibility is the relation of the MB 
model to the Lorenz model, that has isolating integrals for specialized values 
of its parameters. Another possibility is relating the model to a predator prey 
type model. A special solution related to the predator prey system and a class 
of Predator - Prey Models that generalize this model by couplings of the form 
x y in the prey equation or xy . in the predator equation are studied. Stability 
properties of these models are examined. It is also shown that they have limit 
cycles irrespective of the detailed form of the coupling[7, 8, 9, 12, 13] . 
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Abstract 

In this letter, the variational iteration method is applied to solve integral and 
integro-differential equations. Some examples are given to investigate the 
capacity of the method. The results show that the method provides a 
straightforward and powerful mathematical tool for solving various integral and 
integro-differential equations. The considered examples reveal that the method is 
very effective and simple compared with the homotopy perturbation method. 

Keywords: Integral and integro-differential equations 



1. Introduction 

Mathematical modeling of real-life, physics and engineering problems usually 
results in functional equations, e.g. partial differential equations, integral and 
integro-differential equations, stochastic equations and others. Many 
mathematical formulation of physical phenomena contain integral and integro- 
differential equations, these equations arise in fluid dynamics, biological models 
and chemical kinetics; for more details see [1,2] and the references cited therein. 
Integro-differential equations are usually difficult to solve analytically so it is 
required to obtain an efficient approximate solution. Therefore, they have been 
of great interest by several authors. In literature, there exist numerical techniques 
such as Wavelet-Galerkin method (WGM) [3], CAS wavelet approximating 
method [4], Lagrange interpolation method [5] and Tau method [6] and semi 
analytical-numerical techniques such as Adomian's decomposition method [7], 
Taylor polynomials [8], rationalized Haar functions method [9], differential 
transform method [10] and homotopy perturbation method [11]. However, none 
of them propose a methodical way to solve these equations. 
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In recent years, variational iteration method has been used in obtaining 
approximate solutions of a wide class of differential, integral and integro- 
differential equations. The method can solve various different nonlinear 
equations [12-14]. In this work, the variational iteration method has been applied 
to the several integral and integro-differential equations and exact solutions have 
been obtained. 

2. Variational Iteration Method 

Variational iteration method was first proposed by He [15-17] and has been 
successfully used by many researchers to solve various linear and nonlinear 
models [18-21]. The idea of the method is based on constructing a correction 
functional by a general Lagrange multiplier and the multiplier is chosen in such a 
way that its correction solution is improved with respect to the initial 
approximation or to the trial function. 

Now, to illustrate the basic concept of the method, we consider the following 
general nonlinear system 

L[u(t)] + N[u(t)] = g(t) (1) 

where L is a linear operator, N is a nonlinear operator and g(x) is a known 
analytical function. According to the variational iteration methodology we can 
construct the correction functional as: 
i 
u nU (t) = u n (t) + \A{s)[Lu n (s) + M n (s)-g(s)]ds , (2) 

o 
where X is a general Lagrange multiplier, which can be identified optimally via 
variational theory, the subscript n denotes the nth approximation, and u n is 
considered as a restricted variation, namely Su n = . Successive 
approximations will be obtained by applying the obtained Lagrange multiplier 
and a properly chosen initial approximation u Q (t) . 

3. Applications 

Example 1. We first consider the integro-differential equation 

u'(x) = (x + l)e x -x+\ xu{t)dt , w(0) = 0, (3) 

with the exact solution u(x) = xe x (see [4] and [22] ). 

Approximate solution of this problem obtained by homotopy perturbation 

method [23] with four terms has the following form : 

1 2 

u(x) = xe z x (4) 

432 
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We applied the variational iteration method (VIM) to obtain the solution of the 

Equation (3). 

Eq. (3) is equivalent to 

u\x) = {x + \)e x + iyxu{t) — x)dt , (5) 

and its iteration formula reads 



'i n+1 (x) = U n (x) + j' g A(s)\u n '(s)-(s + l)e' -£(ra„(p) -s)dp\ds . 



(6) 



By via variational theory Lagreange multiplier can be find as 

A = -l. ' (7) 

Substituting the identified multiplier into Eq. (6), we have the following iteration 
formula 

u „+i(x) = (x + l)e x -j o |w n '0)-0 + iy -j o (su n (p)-s)dp\ds . (8) 

By variational iteration, 

L(u) = u'(x)-f(x) = (9) 

L(u a ) = u' a (x)-{x + l)e x =0 (10) 

So, we can take u Q (x) as 

u (x) = xe x (11) 

Substituting (1 1) into Eq. (8), we have 

u t (x) = (x + l)e* — i itg (s) — (s + l)e* — (su (p) - s)dp\ds =>w 1 (x) = xe A 

r , i (12) 

m 2 (x) = (x + l)e v - f !«,'(.?) — (i + l)e' v - f (su l (p) — s)dp\ds =>u 2 (x) = xe* 

Similarly 

« 3 (x) = xe x 

u 4 (x) = xe x (13) 

Thus, we obtain 

u(x) = xe x (14) 

which is the exact solution of Equation (3). 

In the Table 1, we list the results obtained by variational iteration method and 
gived the errors for CAS wavelet approximating method [4] , differential 
transform method [22] and homotopy perturbation method [23]. 



Example 2 . We next consider the integro-differential equation 
1 i fi 

3 J » 



(x) = 3e 3v --(2e 3 +\)x + ^3xtu(t)dt , (15) 



with condition 

h(0) = 1 . (16) 
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Table I- 


Numerical results for Example 1 






X 


Error (DTM) 


Error (CAS wavelet ) 


Error (HPM) 


u (exact- VIM) 


0.1 


1.00118319e-02 


1.34917637e_03 


0.2314814815e_05 


0.110517091 


0.2 


2.7865 1355e-02 


1.15960044e_03 


0.9259259259e_05 


0.244280551 


0.3 


5.08730892e-02 


5.67152531e_03 


0.2083333333e_04 


0.404957642 


0.4 


7.55356316e-02 


5.93105645e_02 


0.3703703704e_04 


0.596729879 


0.5 


9.71888592e-02 


1. 3233075 le_02 


0.5787037037e_04 


0.824360635 


0.6 


1.0955 1714e-01 


4.39287720e_02 


0.8333333333e_04 


1.093271280 


0.7 


1.04133232e-01 


1.41201624e_02 


0.1134259259e_03 


1.409626895 


0.8 


0.945 12700e-02 


1.34514117e_02 


0.1481481481e_03 


1.780432742 


0.9 


1.00034260e-02 


1.32045209e_02 


0.1875000000e_03 


2.213642800 



By homotopy perturbation method (HPM), Kajani et al. [24] obtained the 
approximate solution of Eq. (15-16) in the form 



O V 24 



-(1 



48 



3 5 ) 2 L 3 9 27 
e + — \x <H — + — h + . 



8 64 512 



(17) 



In order tol solve Eq. (15-16) we applied the variational iteration method (VIM). 
First, we rewrite the Eq. (15) as 

u'(x) = 3e x + j"[ 3xtu(t)--(2e 3 +1)jc \dt , (18) 

and according to via variational theory its iteration formula reads 



«„ + iW = M n W-j j M n / C ? )-3e 3x -j o rispu n {p)- 
By variational iteration, 

L(u) = u\x) — f(x) = 
L(u ) = u' (x)-3e 3 * =0 
So, we can take u Q (x) as 

m (x) = e 
Substituting (22) into Eq. ( 19), we have 



(2e 3 +l)s\dp\ds 



u { (x) = e x — I I 3e x — 3e v — I 3spe p — (2e +Y)s \dp >ds 



Uy (x) = e " 
Similarly, 
u 2 (x) = e 
m, (x) = e 



(19) 

(20) 
(21) 

(22) 
(23) 

(24) 
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Thus, we obtain 

u(x) = e 3v (25) 

which is the exact solution of Eq. ( 15-16). 

Example 3. Consider the second order integro-differential equation 
i 
u"(x) = e" — x+\ xtu(t)dt (26) 

o 
with initial conditions 

m(0) = 1 , u'(0) = 1 . (27) 

Golbabai and Javidi [11] obtained the approximate solution of Eq. (26-27) by 
using homotopy perturbation method. 

Darania and Ebadian [22] obtained the approximate solution by differential 
transform method (DTM). 

In order to solve this equation we applied the variational iteration method. 
Equation (26) is equivalent to 
i 
u"(x) = e x + U-x + xtu(t))dt , (28) 



„ + i (x) = u n (x) + | o A(s) I u" (s) - e s - J(-s + spu n (p)) dp I ds . (29) 



and its iteration formula reads 

i 



By via variational theory Lagreange multiplier can be find as 

Ms) = s-x (30) 

So, the iteration formula becomes 

u n+1 (x) = u n (x) + j o (s-x)\u"{s)-e -j(-s + spu n (p))dplds (31) 

By variational iteration method, we have 

L(u) = u"(x)-f(x) = (32) 

L(u ) = iig(x) — e x = (33) 

We now obtain 

K(x) = e x . (34) 

So, we can take u Q (x) as 

m (x) = e x + ax + b (35) 

By using initial conditions, we obtain 
w (0) = l + fc = l ^b = 

m '(0) = l + a = l =>a = 
So, we can select 

u (x) = e x (37) 



(36) 
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We now succesively obtain 

u l (x) = u (x)+\ (s — x)iu (s) — e — (— s + spu (p))dp >ds 

u x (x) = e x 

u 2 (x)= e x (38) 

m 3 (x)= e' 

Thus we obtain 

u(x) = e (39) 

which is the exact solution of Eq. (26-27). 

In Table II, we list the results obtained by variational iteration method 
compaired with differential method (DTM) results given in [22] and homotpoy 
perturbation method (HPM) results given in [1 1] at x = 0.2(0.2)1 . 

Example 4 . Consider the nonlinear Volterra integral equation 

u(x) = 2x--x 4 +|-(m(0) 3 dt (40) 



Javidi et al. [25] applied the Adomian method and obtained the approximate 
solution of Eq. (40). 

In order to solve this equation we applied the VIM and obtained the exact 
solution. We can rewrite the Eq. (40) as 

u(x) = 2x + j-(u 3 (t)-8t 3 )dt . (41) 

o 4 
According to the via variational theory, its iterational formula reads 

u n+1 (x) = 2x + ]-(u n 3 (t)-8t 3 )dt , (42) 

o 4 
and 

u g (x) = 2x (43) 

Substituting (43) into Eq. (42) gives 



X 1 

w,(x) = 2x+ — \u Q (t) — $t jdt =>Mj(x) = 2a 



„4 



u 2 (x) = 2x+\-(u 3 (t)-2,t 3 }dt =>m 2 (x) = 2x (44) 



»4' 



Thus, we obtain u(x) = 2x which is the exact solution of Eq. (40). 
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Table II - Numerical results for Example 3 



X 


Error(DTM) 


Error (HPM, N= 


=5) 


Error (HPM, N=10) 


u (Exact- VIM) 


0.2 


4.63 lOe 4 


7.7074e 6 




8.2305e 10 


1.2214 


0.4 


2.9438e 3 


5.9259e 5 




6.5844e 9 


1.4928 


0.6 


7.8064e 3 


2.0000e 4 




2.2222e 8 


1.8221 


0.8 


1.5474e 2 


4.7407e 4 




5.2674e 8 


2.2255 


1.0 


2.6436e_2 


9.2593e_4 




1.0288e_7 


2.7183 



Example 5. Consider the integro-differential equation 
1 r 

u (x) = 1 — x+\xtu(t)dt , 
3 J 



with initial condition 
k(0) = . 



(45) 



(46) 



Golbabai and Javidi [11] obtained the approximate solution of Eq. (45-46) by 
using homotopy perturbation method as 

U (X) = X- 

(47) 



24576 
1 



u (x) = X . 

a PP roA 805306368 



In order to solve this equation we applied the variational iteration method. We 
can rewrite the equation as 



u\x) = 1+ — x + xtu(t) \dt , 



its iteration formula reads 



u n+1 (x) = u n (x)-j\u n \s)-l-j\--s + spu n (p)]dpids, 

and 

u (x) = x 
Substituting (50) into Eq. (45), we have the following results 

M[(x) = x 

u 2 (x) = x 



(48) 

(49) 
(50) 

(51) 



So, we obtain 

u(x) = X 
which is the exact solution of Eq. (45-46). 



(52) 
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4. Conclusion 

In this work, He's variational iteration method (VIM) is applied for solving 
integral and integro-differential equations. Comparison of the result obtained by 
the VIM with that obtained by homotopy perturbation method (HPM) and 
differential transform method (DTM) reveals that the variational iteration 
method is very effective and convenient. 
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Converters for Telecom Applications 
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Chaotic system communication is mainstream application of nonlinear circuits. 
In this paper an alternative approach to multi-bit delta sigma linearization, 
utilizing the wideband non repetitive pattern properties of deterministic chaotic 
signals, is presented. In this fashion the chaotic transmitted signal can also be 
used for DAC linearization. The techniques, algorithms and associated signal 
conditioning for a multi-bit Delta Sigma DAC, suitable for wideband 
communications such as distributed sensor arrays are demonstrated 1 . 

1 Introduction 

The introduction of Chaos Theory in almost all areas of scientific research from 
physics and electronics to social sciences has provided a new perspective [l]-[2]. 
Over the last years the problem of controlling system chaotic behavior has 
become the main issue in all applied science fields [3], [4]. Any strongly 
nonlinear circuit or dynamical system tends to exhibit not only periodic 
behavior, but also more complicated behaviors, ranging from quasi-periodicity to 
chaotic behavior [5]. Potential applications of nonlinear chaotic circuits for 
secure [6], [7] or ultra-wideband data transmission [8], have raised the 
engineering society's interest and offers an alternative way to several new 
applications and performance enhancements to existing communication systems. 
Two key features of chaos are a noise-like time series and sensitive dependence 
on initial conditions and control parameters [9]. A chaotic generator can produce 
nonlinear and non-repeating sequences and it is very hard to predict chaotic 

Digital Input Signal (A) 

Rout 

V\A 






1.8 Volts 

Figure 1: Overall System 
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patterns and sequences even when the chaotic function is known. 
Although communications is a concessive field for applied chaotic electronics, it 
is not the only one. Power electronics [10], as well as, neural computing [1 1] are 
examples of applications other than communications. In this paper a novel 
approach to multi-bit Delta-Sigma converter linearization is presented (Figure 1). 
A random control signal, derived from the input digital signal generator, drives 
the DAC control switches. The randomization, demanded for linearizing the 
DAC, is achieved by the digital words generated by sub-sampling the digital 
output of a Colpitts oscillator, to eliminate the main frequency component. 
Finally, the output current is converted to a voltage signal by the means of a 
current to voltage converter. 

2 Multi-bit Oversampled Data Converters 

Oversampled data converters, well known for their ability to offer the best 
resolution in accuracy, are of a significant importance [12]. Modern applications 
such as digital terrestrial television or ultra-wide-band communications demand 
high accuracy combined to high signal bandwidth [13], while power 
consumption is of increasingly significant importance. This led to the 
introduction of multi-bit- AS converters [14], which reduce the requirement for 
analog reconstruction filters, and can produce more aggressive noise transfer 
functions (for example a fifth order AL modulator can produce 60dB or lObit 
accuracy at an OSR of 16 while the same order AL 4-bit modulator can produce 
in theory 120dB SNR, or 20bits of accuracy). 
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Figure 2: DAC nonlinearities in a 2bit DAC example 

Albeit, the facts presented above lead to the introduction of multi-bit converters 
there is one implied shortcoming introduced in the complexity of the design of 
the associated multi-bit DAC in all AL modulators corresponding to modulator 
accuracy. This is not a trivial task for analog design, since AS modulators were 
introduced mainly to accommodate for accuracy shortcomings of analog circuits. 
The proposed solution utilize averaging in individual DAC element selection. 
This can be explained by the means of Figure 2, showing the response of a two 
bit DAC for demonstration purposes. The data of Figure 2 show a Monte-Carlo 
snapshot for a single variation matrix of the three normalized current sources 
which realize the two bit DAC. The left-most DAC value (-1.5, used for AL 
modulators in order to provide a signal mean of zero for modulation mathematics 
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to be valid) is present when all elementary current sources Ii, I2 and I3 are off and 
a robust «0» value is obtained; this needs to be offset by means of a constant 
current sink (or common mode feedback), in order for the DAC characteristic to 
be centered around «0,0». We also accept the full DAC range value I max =Ii, + h 
+ I3 being accurate (an assumption which if not valid will only yield gain and 
offset mismatches, easily corrected by the AT. digital loop). This also implies that 
the individual current source errors e(n): AI 1; AI 2 and AI 3 give AIi, + AI 2 + AI 3 = 
0, since the full scale DAC output is accurate. As a result, the average output 
value £y(n)=£f(n) + Ze(n) becomes £f(n), since £e(n)— >0 for a large number of 
samples; or in other words the DAC transfer function is the line connecting all 
mean values derived by Ii, I 2 and I3 combinations. In this way the DAC 
linearization is achieved by averaging. 

3 Generation of Random Control Signals 

The Random Control Signal Generator (RCSG) unit takes as an input a random 
digital word-level signal with an appropriate number of bits (e.g. 32) and creates 
an output of a set of 2 N -1 bits (N is the DAC accuracy) with programmable 
values of ones and zeros driving the DC switches. The number of Is (and of 
course of 0s) in the output signal can be configured according to the value of a 
control input signal A (the digital input signal). 

If A=k the number of Is in the output signal should be k (k<2 N -l). These Is 
should be distributed in a random way along with the bits of the output word. 
Instead of designing a specialized unit to achieve that, which is a rather difficult 
task, all the corresponding combinations were stored in a ROM and addressed by 
random values. In our case where N=3, there exist k Is and (7-k) 0s, thus the 
total number of different output combinations is given by 7!/ A:! (7 - k)l . The 
number of these combinations is shown in Table 1. 
Table 1: Combinations for different values of A 



A 





1 


2 


3 


4 


5 


6 


7 


Combinations 


1 


7 


21 


35 


35 


21 


7 


1 



For A=k and ^4=7-k the same number of combinations is achieved. Also, each 
combination results from another, simply by inversion of bit values. For 
example, when A=3 a possible combination is 0100110, and the corresponding 
combination for A=4 results to 1011001. In this way, we can store only the 
combinations for half of the values of A (0, 1, 2 and 3) and the rest will be 
provided by the appropriate inversion. 

The RCSG unit is shown in Figure 3. For convenience and in order to simplify 
the design, three different ROMs were used for storing the corresponding 
combinations for A=\, 2 and 3. For A=0 only one combination exists "0000000" 
and was set as a fixed value. The outputs of the ROMs (and the combination 
"0000000") are fed to a multiplexer, which is controlled by the 3-bit input signal 
A (a2ala0). The XOR gates in the control bits and the output bits are used to 
make the appropriate inversions, so that the circuit can provide the combinations 
for A=4, 5, 6, and 7. Addresses for the ROM are provided by the Random 
Address Generator (RAG) unit, which takes as input a number of groups (e.g. 5) 
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of bits (e.g. 5 bits) of the output of a sub-sampled chaotic digital system. Since 
the number of the words stored in the ROMs is not a power of 2, the creation of 
random addresses is not a straightforward procedure and appropriate circuits 
should be designed. 

The RAG unit consists of three different circuits, each one responsible for 
providing random addresses to the corresponding ROM. Taking as input a 
number of bits with random values, each circuit has to provide to its output some 
numbers with random distribution. For example, RAG2, shown in Figure 4, 
provides addresses for ROM2 (A=2) and has to create in its output 21 numbers 
(e.g. from up to 20) uncorrelated and with similar probability to appear. Since 
21 is not a power of 2, this makes things quite complicated. 
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Figure 3: The Random Control Signal Generator 

RAG2 takes as input groups of bits from an output of a digital chaotic system. 
Each group is compared to 20. The output of each comparator controls the 
selection in the corresponding multiplexer, as shown in Figure 4. If the binary 
value of Group 1 is less than 21, then Group 1 is an acceptable address (in the 
range - 20) and is passed to the output, addressing ROM2. If Group 1 is higher 
than 20, then Group 1 is not a valid address and MUX2 takes the responsibility to 
provide the right address. This appears with a 34.44% probability. Group2 is 
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Figure 4: Random Address Generator 
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compared to 20. If Group2<21, Group2 will be the valid address; otherwise, 
MUX3 takes the responsibility to provide the right address. This probability of is 
11.82%. Group3 is compared to 20. If Group3<21, Group3 will be the valid 
address; otherwise, Counter takes the responsibility to provide the valid address. 
Now this probability is 4.06%. Since the counter takes values from to 20, the 
probability of a number to appear at its output in a random time instance is 1/21, 
4.76%. Therefore there is an equal probability (0.19%) for any number to appear, 
with the exception of 4 individual values (of a 0.39% probability). This 
probability mismatch is very small and does not affect the linearized DAC. 
Corresponding circuits, with similar structure, are used for RAG1 and RAG3 to 
address ROM1 (A=l) and ROM3 (A=3), respectively. In case of RAG1 addresses 
0-6 are provided. Two Group inputs of 3 bits are compared to 6. Two 
multiplexers and a 0-6 counter are also needed. In case of RAG3 addresses 0-35 
are provided. Five Group inputs of 6 bits are compared to 34. Consequently five 
multiplexers and a 0-34 counter are demanded. 

4 Colpitts Oscillator 

A modified FET-based Colpitts oscillator implementation has been proposed and 
proven to exhibit a chaotic behaviour [15]. This oscillator is a three-dimensional 
nonlinear system and its dynamics are governed by the following (normalized) 

15.5 



13.5 






-4e+06 -3e+06 -2e+06 -le+06 le+06 2e+06 

Figure 5: A typical chaotic time series and the associated phase portrait, 
produced by the Colpitts chaotic oscillator. 
set of equations: 

x = a- z-f(y) 

<y = -b-y-a-z + p (1) 

Z = -c-x-d-y-g-z + q 

The system state variables x, y, z correspond to the capacitor voltages and the 
inductor current, while parameter values are dependent on the circuit's elements 
and supply voltages. Function f(y) in the first of Eq. (1) is defined as follows: 

f(y)Kk(y-iy (2) 
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As already mentioned, for certain parameter values this Colpitts oscillator could 
operate in a chaotic mode [15]. A digitized implementation of the above 
described oscillator provided normalized time series and the associated phase 
portrait illuminated in Figure 5. 

4.1 Sub-sampling and randomization 

When the above described Colpitts oscillator chaotic behaviour, it still 
demonstrates a strong sinusoidal component: its center frequency (in our case 
31.4MHz). Due to this the resultant signal is deterministic and not suitable for 
acting as a stochastic random number. However, if this center frequency was to 
be rejected the wideband chaotic signal should exhibit frequency behaviour 
similar to that of white noise. This can be achieved by utilizing sub- sampling 
techniques. 

Chaotic Colpits Oscillator Output Power 




Subsampled Chaotic Signal Power Distribution (fs=31 ,4393MHz) 
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Figure 6: Colpitts Oscillator output and sub-sampled chaotic output 

This in effect cancels the strong sinusoidal frequency component shown in 
Figure 6, while folds the entire spectrum over 31.4MHz down to the interval 
from DC to 31MHz. As a result, the sub-sampled signal spectrum becomes 
almost uniform with the exception of a limited area around the DC. 

5. Analog Design of the Current DAC 

The DAC circuit is shown in Figure 7. The right side is the elementary DAC 
block, this is repeated 2 N -1 times (N is the DAC resolution), to achieve the 
desired thermometer coded DAC circuit. Transistor Ml gives the elementary tail 
current and is biased to the desired gate level which defines this appropriate 
current. The differential transistor pair M2, MS is a current steering switch, 
driven by the input signal IN and its non-overlapping inverted version. In that 
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Figure 7: Elementary DAC Circuit and Bias Shematic 
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fashion the tail current is either driven to the output node {OUT) or to the power 
supply rail (Vdd=1.8V). The length of Ml is twice the minimum device 
geometry, to ensure some channel length modulation reduction, with the 
appropriate width for the given current is chosen. Transisors M2, M3 are 
operating as switching devices and therefore require minimum length and half 
the width of Ml, to realize similar bias conditions. This elementary cell needs to 
be repeated as desired to realize the appropriate current DAC accuracy. 
The bias circuit is consisted of M4, M5, M6 and R. M6 is a diode connected 
replica version of Ml and is biased by the reference current Ibias, the gate 
voltage (Vbias) of this device will therefore raise to the appropriate level to 
ensure both M6 and Ml sink the same current Ibias. However, potentially 
different voltage levels on the drains of M6 and Ml will result in a different 
current on Ml. To minimize this the transistor M5 is used, which is the same size 
as M2, M3 and connected to Vdd. This ensures that the voltage drain on M5 is 
exactly the same as on Ml, furthermore M4 and R form a source follower and 
thus a unity gain buffer to ensure input isolation to the bias generating point. 
To further enhance voltage stability the output signal is assumed to drive the 
high impedance input of an OPAMP as shown in Figure 1 with a common mode 
voltage of 1 .8V and a supply level of 3.6V. 

5.1 Simulation Results 



A three bit DAC was realized on a 1 80nm process. The input was assumed to be 
a full range sinusoidal signal. The DAC was deliberately mismatched by 
modulating the width of the individual current sources (Ml in Figure 7). The 
initial output current signal is observed in the left side of Figure 8 and appears to 
be a sampled sinusoid, while transient switching glitches are also noted with 
insignificant feed-through contribution. Those glitches are essentially the charge 
that needs to be injected on the drain of M2 for every switching element. The 
output signal Fourier transform, without utilizing the techniques presented in this 
paper, is shown in the lower right side of Figure 8. It is clear that the sine wave is 
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Figure 8: DAC Simulation Results 

significantly distorted with power leaking and higher harmonics. Once the 

proposed system is in place the output signal FFT (upper right side in Figure 8) 
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is enhanced. Two observations are inevitable: the power leaking to neighboring 
frequencies and higher harmonics is diminished, while the overall Fourier noise 
is increased. In other words all this unwanted power in specific frequencies is 
appearing as flat noise spectral density in the observed spectrum. 

7. Conclusions 

In this paper a novel application for chaotic systems is demonstrated. This real- 
world circuit implementation diminishes the inherent analog nonlinearities of a 
multi-bit DAC. This was achieved by utilizing an already existent chaotic 
oscillator output signal, and applying common place signal conditioning to it. 
This wideband noise-like signal was fed to a digital block, in order to randomize 
the control of the switching arrangement of a current steering DAC. 
Simulation results in the Cadence DFII environment, for a 180nm technology, of 
the overall system were presented, to signify the appropriate operation of the 
approach. It is approaches like this that can also demonstrate the applicability of 
chaotic signal conditioning to other novel areas of IC design. 
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In this paper, theoretical and experimental investigations of chaos 
synchronization and its application to chaotic data transmission in a 
communication scheme with two identical nonlinear circuits are presented. The 
conditions for chaos synchronization and its application as a secure 
communication system based on two 4* order non-autonomous chaotic circuits 
are studied. Information signal transmission and recovery are demonstrated. The 
information signal is embedded in a chaotic carrier by using the chaotic masking 
technique. 

Keywords: Non-autonomous circuit, unidirectional coupling, chaos 
synchronization, chaotic masking, secure communication. 

1 Introduction 

Chaotic systems are dynamical systems with long-term unpredictable behaviour. 
Two identical non-autonomous chaotic systems started at nearby initial 
conditions have trajectories that diverge exponentially. Although the systems 
could have identical attractors in state space, determining where on the attractor 
the system is at a distant, future time given its position in the past is a problem 
that becomes difficult to predict as time passes. One way to demonstrate this is to 
run two, identical chaotic systems side by side, starting both at close, but not 
exactly the same initial conditions. The systems soon diverge from each other, 
but both retain the same attractor pattern. The position of each system on its own 
attractor has no relation to where the other system is, thus would seem 
impossible to synchronize. 



This work was partly presented in the "3rd International Interdisciplinary Symposium on Chaos and 
Complex Systems - CCS2010". 
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Since the first prediction of chaos synchronization by Pecora and Carroll [1], 
synchronization of chaotic oscillations between two nonlinear systems has been 
reported in various fields of science, such as electronics [2]-[5], optics [6]-[9], 
biomedicine [10]-[11], etc. To use a chaotic signal in communications a basic 
requirement must be satisfied: somehow the receiver must have a duplicate of 
the transmitter's chaotic signal or, better yet, the two systems must be 
synchronized. In fact, synchronization is a requirement of many types of 
communication systems, not only chaotic ones. Chaos synchronization and its 
application to communications have received a great deal of attention the last 
twenty years [1], [12]-[16]. Synchronization has opened the way to scientists to 
investigate an engineering application of chaos, to design secure communication 
systems [17]-[19]. Synchronization is a basic requirement for chaotic secure 
communications [1], [20]. 

In this paper, theoretical and experimental results of chaos synchronization of 
two identical, unidirectional coupled, non-autonomous circuits are presented. A 
chaotic secure communication system based on two 4' order non-autonomous 
chaotic circuits is proposed. The chaotic masking technique is used. In chaotic 
masking [16] the randomness of chaos is utilized to mask the information signal 
and the original signal is decoded (unmasking) from the received signal by a 
system (circuit) with an elaboration. 

2 Circuit's Dynamics 

The circuit, we have studied, is presented in Figure 1. It is a four-dimensional 
non-autonomous, non linear electronic circuit, with two active elements, a 
nonlinear resistor R N and a linear negative conductance G n . The circuit's 
parameters are considered unchangeable during our study. More particularly: 
Li= L 2 = lOOmH, Ci= 33nF, C 2 = 75nF, Ri= 1KQ. We consider a sinusoidal input 
signal v s (t) with V D = 0.75V and f=35Hz. The theoretical v-i characteristics of the 
nonlinear element and negative conductance are seen in Figures 2(a) and 3(a), 
while in Figures 2(b) and 3(b) the experimental characteristics are presented, 
respectively. To compare directly theoretical and experimental results we must 
divide the values of experimental y-axis (voltage in mV) by 10 (current in mA). 




Figure 1. Non-autonomous circuit 
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Using Kirchhoff s circuit laws, the following state equations (Eqs. (l)-(4)) for 
the system have been derived. 



dt c, lL1 RNJ 

dv ri 1 



dt C 



■(G n -Vc2 +i Ll +i L2) 



^- = — Cv -v -Ri ) 
dt L, lc2 C1 1Llj 



— = — [v r2 -R 2 i, 2 -v(t)l 
dt L 2 L C2 2L2 s J 



(1) 

(2) 
(3) 
(4) 



Where the current ip^ through the nonlinear element and input signal v s (t) are 
given by Eqs. (5) and (6). 



i RN =g(v C] )=G b v C] +0.5(G a -G i )(|v cl +B p |-|v cl -B p |) 

V s (t)=V -COS(27lft) 



(5) 
(6) 





(a) theoretical (b) experimental x: 200mV/div, y: 2mV/div 

Figure 2. input characteristics of R N with G a = -0.35mS, Gb= 5.0mS and B p =0.8V 
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(a) theoretical (b) experimental x: 5V/div, y: 20mV/div 

Figure 3. input characteristics of G n with G n = 0.50mS= -G p and B p = 7.5V 

Circuit's dynamics in low frequency area has been extensively studied in the past 
[21]-[23]. Using the above parameters circuit exhibits chaotic behaviour. In 
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Figures 4(a), (b) and (c) the theoretical and experimental phase portraits, as well 

as the Poincare section are presented. 

In Figures 5(a) and (b) theoretical and experimental diagrams Vcn vs. Vc2i are 

presented, while the two systems are uncoupled. In Figures 5(c) and (d) 

theoretical and experimental diagrams Vc22(t) - Vc2i(t) are presented. We can see 

that the two systems have the same pattern-attractor but they are not 

synchronized. 





(a) v C2 vs . v c i (b) v C2 vs . v c i (c) (v C2 ) P vs . (i L2 ) p 

Figure 4. (a) theoretical (b) experimental (c) Poincare section 




(a) theoretical 


Vc22 VS. Vc21 
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lff'lj|i 




i i i : 







(b) experimental v C 22 vs. Vc2i 




(c) theoretical Vc2z(t) _ v C 2i(t) (d) experimental v C 22(t) - v C 2i(t) 
Figure 5. (a), (b) x: lV/div, y: lV/div (c), (d) x: 5ms/div, y: lV/div 

3 Unidirectional Coupling 

First of all, chaotic communication requires that the two identical subsystems 
would be synchronized. Second, with no parameter mismatch, exact recovery is 
possible involving only some simple signal processing techniques, such as 
summation, subtraction and inversion. When two identical circuits are resistively 
coupled, complex dynamics can be observed, such as chaotic and hyperchaotic 
synchronization, as the coupling coefficient is varied. The two circuits can be 
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either v C i-coupled or v C 2-coupled. The unidirectional v C2 -coupled system of two 
identical non-autonomous nonlinear circuits via a linear resistor R c is illustrated 
in Figure 6. 



L, 



v,(0 




^ru 



Ci 4 



Rn 




yc*S^L*X- 



K, 



C 3 



c, 



Figure 6. Unidirectional coupling of two non-autonomous circuits 

The two circuits are synchronized for coupling resistance Rc< 3.0kf2. In Figures 
7(a) and (b) the theoretical and experimental phase portraits v C 2iVc22 are 
presented, while in Figures 7(c) and (d) we can see theoretical and experimental 
diagrams VczzO)- v C2 i(t). 




(a) theoretical Vc 22 vs. Vc2i 



,,™j J 




(c) theoretical v C22 (t) - v C2 i(t) 



(d) experimental v C2 2(t) - v C2 i(t) 



Figure 7. Chaotic synchronization for coupling resistance Rc= 3.0kO 
(a), (b) x: lV/div, y: lV/div (c), (d) x: 5ms/div, y: lV/div 



209 



PAPADOPOULOU ET AL: CHAOS SYNCHRONIZATION 



4 Chaotic Communication 

The proposed communication system is based on chaotic masking technique and 
presented in Figure 8. 



Information signal s(t) 



Master System 



Chaotic 
Transmitter 



Communication , 
Channel 



Slave System 



Chaotic 
signal 



Transmitted 
signal 



Chaotic 
Receiver 



Chaotic 
signal 



— ►Recovered 
signal s'(t) 



Figure 8. Chaotic communication system using masking technique 




(c) theoretical transmitted signal (d) experimental transmitted signal 




(e) theoretical s(t) - s'(t) 




(f) experimental s(t) - s'(t) 



Figure 9. (a), (b) x: 2ms/div, y: 500mV/div (c), (d) x: 2ms/div, y: lV/div (e), (f) 

x: 500us/div, y: 5mV/div 
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The information s(t) is a sinusoidal signal with V os = 0.40V and f s = 1kHz and is 
given by Eq. (7): 

s(t)=V os -cos(2;if s t) (7) 

In Figure 9(a) the theoretical information s(t) (above) and recovered s'(t) (below) 
signals are presented, while in Figure 9(b) we can see the experimental ones. In 
Figure 9(c) and (d) the theoretical and experimental transmitted signals are 
displayed, while in Figures 9(e) and (f) the theoretical and experimental s(t)-s'(t) 
are presented. 

5 Conclusions 

In this paper, theoretical and experimental study of chaos synchronization of two 
identical, 4 th order, unidirectionally coupled, non-autonomous circuits is 
presented. The two circuits are been synchronized for coupling resistance Rc< 
3.0kQ. A chaotic secure communication system based on chaotic masking 
technique is proposed. Transmission and recovery of a sinusoidal input signal are 
demonstrated. Both, theoretical and experimental results verified the 
performance of proposed secure communication system and showed that the 
difference between transmitted information s(t) and recovered information s'(t) 
is less than 5mV. The investigation of communication scheme established that 
chaotic secure communication using the two non-autonomous 4 l order circuits is 
feasible and efficient. 
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1 Introduction 

The method of Lyapunov's stability has been very useful and fruitful techniques in the qual- 
itative theory of differential equations since it is a practical tool in the investigation of the 
behavior of solutions of differential equations. It has been applied to investigate the behav- 
ior of unperturbed and perturbed systems in nonlinear differential systems [2,4,5,6,7,8] the 
boundedness, stability properties of unperturbed systems. Recently in [1, 5, 6, 7, 8], the study of 
initial value problems with an initial time difference has been initiated and the corresponding 
theory of differential inequalities has been investigated. As in all measurements, errors occur 
in measurements of starting time and the solutions of an unperturbed differential system may 
start at an initial time that is different than the starting time of the perturbed differential 
system. In real situations it may be impossible to have only a change in the space variable and 
not also in the initial time. 

We investigate strict stability criteria of an unperturbed system with different initial conditions 
and unperturbed systems with different initial conditions. We are not only consider the change 
in initial position, but also an initial time difference. Previously, the investigation of initial 
value problems in differential equations has been restricted to a perturbation only in the space 
variable with the initial time unchanged. 

2 Definition and Notation 

Consider the differential systems 

x' = f(t, x),x(t ) = x for t > Tq > t , t E K+ (2.1) 
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where / G C [K+ x M. n , M. n ] and r\ = To — to > 0. Assume that we have the sufficient conditions 
for the existence and uniqueness of the solutions x(t) = x(t,to,xo) of (2.1) for t > to and 
y(t)=y(t,To,yo)of(2.1)fort>ro. 

Let us give the definition of the strict stability criteria with initial time difference. 
Definition 2.1: The solution y (t, To, yo) of the system (2.1) through (to, yo) is said to be initial 
time difference strict stable with respect to the solution x (t — rj, t , xo), where x (t, to, xo) is any 
solution of the system (2.1) for t > To > 0, t G R + and rj = To — t . If given any ei > and 
r G K + there exist Si = Si (ei, r ) > and S 2 = S 2 (ei, r ) > such that 

\\y (t, r , yo) -x(t- rj, t , xo) || < ei for t > r 

whenever \\y — xo\\ < Si and \tq — £o| < ^2 and, for S\ < Si and S* 2 < S 2 there exist e 2 < 
min {SI, S 2 } such that 

\\y (t, r , yo) ~x(t- r], t , x ) || > e 2 for t > r 

whenever \\y — x \\ > S\ and |r —t \> S* 2 . 

Definition 2.2: If Si,S 2 and e 2 in Definition 2.1 are independent of To, then the solution 

y(t,To,yo) of the system (2.1) is initial time difference uniformly strict stable with respect to 

the solution x (t — r\, to, xo) for t > To. 

Definition 2.3: The solution y(t,T ,yo) of the system (2.1) through (r ,|/o) is said to be 

initial time difference strictly attractive with respect to the solution x (t — r],t ,Xo), where 

£(£,£0,^0) is any solution of the system (2.1) for t > r > 0,to G 1R+ and rj = To — t . If 

given any «i > 0, 7 1 > 0,ei > and To G K+, for every a 2 < «i and 7 2 < r y 1 , there exist 

e 2 < ei,Ti = T\ (ei, To) and T 2 = T 2 (ei, To) such that 

\\y {t, r , yo) -x(t-rj, t , x ) I) < ei for T x + r < t < T 2 + r 
whenever \\y — x \\ < a\ and |r — to I < Ti and 

||y (t, r , yo) - x(t-rj, to, xo) \\ > e 2 for T 2 + r > t > Ti + r 

whenever ||t/ — #o|| > a 2 and |r — t \ > 7 2 . 

If T^and T 2 in Definition 2.3 are independent of r , then the solution y(t, r , |/o) of the system 

(2.1) is initial time difference uniformly strictly attractive stable with respect to the solution 

x(t-r],to,xo) for t > T . 

Definition 2.4: The solution y(t,To,yo) of the system (2.1) through (to,2/o) is said to be 

initial time difference strictly assimptotically stable with respect to the solution x(t — rj, t , xq) 

if Definition 2.3 satisfies and the solution y(t,T ,yo) of the system (2.3) through (r 0,2/0) is 

initial time difference strictly stable with respect to the solution x (t — 77, t , #o)- 

If Tiand T 2 in Definition 2.3 are independent of To, then the solution y(t,To,yo) of the 

system (2.1) is initial time difference uniformly strictly assimptotically stable with respect to 

the solution x(t — rj, to, Xq) for t > To- 

Definition 2.5: For any function V n G C\R + x M n ,lR + ], we define the Dini derivative of the 

function with respect to the solution of the system (2.1) 

D + V(t,y-x)= lim sup - [V (t + h, y - x + h (f(t, y) - f(t, x))) - V (t, y - x)} 
h — >o+ h 
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and 

D_V{t,y-x) = lim mi]-[V(t + h,y-x + h(f(t,y)-f(t,x)))-V(t,y-x)} 

h >0 fl 

where y = y (t, r , yo) and x = x (t, t , x ) for (t, x) and (t, y) G M + x W 1 . 

Definition 2.6: AC is said to be the class AC set of functions such that 

AC := [a : a G C([0, p],R+), a is strictly increasing and a(0) = 0] and S p = {z G M n . : ||^|| < p}. 

3 Main Results 

In this section we obtain the strict stability concepts with initial time difference parallel to the 
Lyapunov's results. 

Theorem 3.1: Assume that 

(Ai) for each p ,0 < p < p, V^G C\R + x 5 P , R+] and V^ is locally Lipschitzian in z and for 

(t, z) G M+ x 5 P and ||^|| > p , 

6i(INI)<^(*^)<«i(lkll)>«i>6ie/C 

+ ^(M)<O; (3.1) 

(A 2 ) for each 6>, < < p, V<j G C[R+ x S^, IR + ] and V$ is locally Lipschitzian in z and for 
(t,z) ER+x S p and ||^|| <$, 

h(\\z\\) < V e (t,z) < a 2 (\\z\\), a 2 ,b 2 G AC 

D + V e (t, z) > 0; (3.2) 

where z(t) = y(t,T ,y )-x(t-r],t ,x ) fort > T ,y(t,T ,y ) of the system (2.1) through (r ,y ) 
and x(t — rj, t , x ), where x(t, t , x ) is any solution of the system (2.1) for t > r > 0, t G M + 
and rj = tq — to- 
Then the solution y(t, ro, j/o) of the system (2.1) is the initial time difference strictly stable with 
respect to x(t — r\, to, Xo) of the system (2.1) for t > To > 0, t G M+ and rj = To — t . 

Proof of Theorem 3.1: Let < e\ < p and r G R+. Let us choose 8\ = 5i(ei,r ) > such 
that 

Oi(5i) < 6i(ei) (3.3) 

since we have &i(ei) < Oi(5i) in (^4i). Then we claim that 

||y(t,r ,yo) -x(t-ri,to,Xo)\\ < a fort > r (3.4) 

whenever ||t/ — %o\\ < Si and |ro — to I < S 2 . 

If (3.4) is not true, then there exist t\ > t 2 > r and the solution of (2.1) with \\y — x Q \\ < 

Si, | t — to | < S 2 satisfying 
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y{ti)-x{h) 



ei, 



y(t 2 ) - x(t 2 ) 



S± and Si < 



y{t)-x{t) <ei forte [t 2 ,ti\. 



Let us set p = <5i,and using (Ai) we can obtain 



61 (ei) = 61 ( y(ti)-x(ti) )<V fI (ti,y(ti)-x(ti)) 

< Vp(t 2 ,y(t 2 )-x(t 2 )) < ai(||y(t 2 ) -,x(t 2 )||) = ai(<5i) 

which contradicts with (3.3). Hence (3.4) is valid. 

Now let < SI < Si,0 < S* 2 < S 2 and e 2 < S = minjc^, S^} such that 

a 2 (e 2 ) < h(S) 
since we have a 2 (e 2 ) > b 2 (S) in (A 2 ). Then we can prove that 



(3.5) 



(3.6) 



e 2 < \\y(t, Tq, y ) - x(t - n, t , Xq) \\ < ei for t > r 

whenever <5* < \\y — x \\ < Si and S* 2 < \t — t \ < S 2 . 

If (3.6) is not true, then there would exist t\ > t 2 > r and the solution of (2.1) and (3.2) with 

S* ± < \\y — .T || < Si,S 2 < l r o ~~ t | < S 2 satisfying 



y(ti)-x(ti) 



e 2 , 



y(h) - x(t 2 ) 



S and 



y{t)-x{t) <S for t G [t 2 ,ti\. 



(3.7) 



Let us set 9 = S and using (A 2 ), we get 



a 2 (e 2 ) = a 2 ( y(ti)-x(ti) )>V e (ti,y(ti)-x(ti)) 

> V e (t 2) y(t 2 ) - x(t 2 )) > b 2 (\\y(t 2 ) - ,x(t 2 )||) = b 2 (S) 

which contradicts with (3.5). Thus (3.6) is valid. Then the solution y(t,To,yo) of the system 
(2.1) through (ro,?/o) is initial time difference strictly stable with respect to the solution x(t — 
r],t ,x ). 

This completes the proof of Theorem 3.1. 

If Si, S 2 and e 2 in Theorem 3.1 are independent of To, then the solution y (t, To, yo) of the system 
(2.1) is initial time difference uniformly strict stable with respect to the solution x (t — rj, to, xo) 
for t > To- 

Theorem 3.2: Assume that 

(^4i) for each p ,0 < p < p, V^G C\R + x 5p,R + ] and Vp is locally Lipschitzian in z and for 

(t, z) G R+ x S p and ||^|| > p , 

MINI) ^ v ti(t, z ) < ai(H^H), ai, 61 G AC, 

D + Vp(t, z) < -ci(\\z\\) ci E 1C; (3.8) 

(A 2 ) for each 9, < 6 < p, Vq G C\R + x S^, IR + ] and V$ is locally Lipschitzian in z and for 
(t,z) ER+x S p and \\z\\ < 0, 
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b 2 {\\z\\)<V e {t,z)<a 2 {\\z\\),a 2 ,b 2 e1C, 

D + V e (t,z)>-c 2 (\\z\\)c 2 £lC; (3.9) 

where z(t) = y(t,T ,y )-x(t-r],to,Xo) fort > T ,y(t,T ,yo) of the system (2.1) through (r ,yo) 
and x(t — r\, to, Xq), where x(t, to, xq) is any solution of the system (2.1) for t > To > 0, t G R+ 
and rj = To — t . 

Then the solution y(t,T ,yo) of the system (2.1) through (r ,2/o) is the initial time difference 
strictly asymptotically stable with respect to x(t — rj, t , x ) of the solution of the system (2.1) 
for t > t > 0, t G IR+ and f] = t — t . 

Proof of Theorem 3.2: We note that (3.8) implies (3.1). However, (3.9) does not yield (3.2). 
As a result of these, we obtain because of (3.8) only stability of unperturbed systems with 
initial time difference with respect to x(t — rj,to,x ) that is for given any e\ < p and To G M+ 
there exist <5i = <5i (ei, t ) > and S 20 = 5 2 o(ei, To) > such that 



\\y(t,T ,y ) -x(t-r],to,Xo)\\ < ei fort > r whenever ||y -£o|| < $w and \t - 1 \ < 5 20 . 

(3.10) 
To prove the conclusion of Theorem 3.2 we need to show that the solution y(t, To, yo) of the sys- 
tem (2.1) through (to, yo) is strictly attractive with respect to x{t — rj, to, xo) for this purpose, let 
ei = pand set <5io = Si(p, To) and S 2 o = S 2 (p,To) so that (3.10) yields \\y(t,To,yo) — x(t — rj,to,xo) 
p for t > r whenever \\y — x \\ < Si and |r — t | < S 2 . 

Let 1 1 yo — x o\\ < ^io an d | t — t 1 < S 20 . We show, using standard argument, that there exists a 
t* G [to, to+T], where T = T(e, tq) > "^ s°'s) w ^ere 8\o and c>2o are the numbers corresponding 
to ei in (3.10) that is in stability of unperturbed systems with initial time difference with 
respect to x(t — r),to,xo) such that \\y(t* ,To,yo) — x(t* — rj, to,.xo)|| < S\ for any solutions of 
the system (2.1) with \\y — x \\ < S w and \t — 1 \ < S 20 . If this is not true, we will have 
\\y(t* ,To,yo) — x(t* — r],to,Xo)\\ > Si for t* G [t ,t + T}. Then, p = Si and using (Ai) with 
(3.8), we have 



< 



h(Si) < h{ y{To + T)-x{To + T) ) 

< V^To + T,y(T + T)-x(To + T)) 

"T +T 



< V^(To,yo-x ) 



Cl( 



TO 



y(s) — x(s) )ds 



< a,i(Sio,S 20 ) -Ci(Si,S 2 )T 

< h(Si) 



in view of the choice of T. This contradiction implies that there exist a t* G [tq, tq+T] satisfying 
\\y(t* , To, yo) — x(t* — r], to, xo) \\ < S\. Because of the stability y(t, To, yo) of unperturbed systems 
with initial time difference with respect to x(t — rj,t ,Xo), this yields that 

\\y(t, tq, y ) - x(t - rj, t , x ) \\ < ei for t > r + T > t* 
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which implies that there exists a, tq < T\ < T such that 

||2/(t + Ti,t ,2/o) ~x(tq + T 1 - rj, t Q ,x Q )\\ = e x . 

Now, for any 5i2,0 < 812 < 5io and < #12 < $20 we can choose e 2 such that 62(61) > 02(62) 

and < e 2 < ei < 812- 

Suppose that S12 < \\yo — x \\ < min{c>io,c>2o} and 612 < \tq — t | < min{c>io,c>2o}- Let us define 



T 



fe2(ei)-a2(e2) 
C2(ei) 



, and T 2 = Ti + r. Since ||y(t,r ,2/o) - #(* - 77, t , a: )|| < e x for t > r + T u 



choosing 9 = e\ and using (A 2 ) with (3.9) we have for t G [tq + Ti, tq 4- T 2 ] 



0,2 ( 



y(t)-x(t) ) > ^(t )2 /(t)-x(t)) 

> Ve(r + Ti, y(r + Ti) - ,x(r + T x )) - / 



C2( 



TO+Tl 



y{s) 



X(S 



)ds 



y(s) — x(s) )ds 



> &2(eiJ - / c 2 

'ro+Ti 

> 62(61)- c 2 (ei)[t-(r + T 1 )] 



Since, t — (r + Ti) > r, it follows that 



a 2 ( y(t)-x{t) )>6 2 (ei)-c 2 (e 1 )[ 



62(61) -02(62) 
c 2 (ei) 



«2ie 2 J 



This yields that 



\y(t, tq, y ) - x(t - rj, t , x ) \\ > e 2 for t G [r + Ti, r + T 2 ] 



and therefore, 



e 2 < \\y(t, tq, y Q ) - x(t - rj, t , x ) \\ < ei for t G [r + Ti, r + T 2 ] 



This completes the proof. Then the solution y(t,To,yo) of the system (2.1) through (to, yo) is 
initial time difference strictly asymptotically stable with respect to the solution x(t — rj, t , x ), 
where x(t, to, xo) is any solution of the system (2.1) for t > To > 0, to G M+ and 77 = To — t . 
If Ti and T 2 in Theorem 3.2 are independent of To, then the solution y(t,To,yo) of the sys- 
tem (2.1) is initial time difference uniformly strictly assimptotically stable with respect to the 
solution x(t — rj, t , x ) for t > r . 

Before we prove the general result in terms of the comparison principle. Let us consider the 
uncoupled comparison differential systems, 



(i) u[ = gi(t,ui),ui (r ) = u w > 
(ii) u' 2 = g 2 (t, u 2 ),U2 (r ) = u 20 > 



where g u g 2 G C \R 2 + ,R] 



(3.11) 



The comparison system (3.11) is said to be strictly stable: If given any ei > and t > To, To G 
R + , there exist a 8\ > such that 

Uw < Si implies U\(t) < e 1 for t > r 
and for every 82 < 8\ there exists an 62 > 0, < e 2 < 82 such that 
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U20 > S 2 implies u 2 (t) < e 2 for t > tq. 

Here, U\(t) and u 2 (t) are any solutions of (i) in (3.11) and (ii) in (3.11); respectively. 

Following main result based on this definition that result is formulated in terms of comparison 

principle. 

Theorem 3.3: Assume that 

(Ai) for each /i , < \l < p, V^ E C\R + x S p , R+] and V^ is locally Lipschitzian in z and for 

(t, z) E R+ x 5 P and ||z|| > /i , 

&i(IMI) < V^(i,z) < ai(||z||),ai,6i G /C, 

+ ^(M)<0i(*,^(M)); (3.12) 

(A 2 ) for each 6,0 < 6 < p,V$ E C\R + x S^R+j and V$ is locally Lipschitzian in z and for 

(t,z) ER+x S p and ||^|| < 0, 

b 2 {\\z\\)<V e {t,z)<a 2 {\\z\\),a 2 ,b 2 ElC, 

D + V e (t,z)>g 2 (t,V $ (t,z)); (3.13) 

where g 2 (t,u) < 9i(t,u),g 1 ,g 2 E C[R 2 + ,R], g x (t, 0) = £ 2 (*,0) = and «(t) = y(t,T ,y ) - x(t - 
r),to,xo) for t > To,y(t,To,yo) of the system (2.1) through (to,t/o) arid a;(t — r],to,Xo), where 
x(t, to, #o) is any solution of the system (2.1) for t > To > 0, t G M+ and 77 = To — t . 
Then any strict stability concept of the comparison system implies the corresponding strict 
stability concept of the solution y(t,T ,yo) of the system (2.1) through (t ,t/ ) with respect to 
the solution x(t — r],t ,x ) of the system (2.1) with initial time difference where x(t,t ,x ) is 
any solution of the system (2.1) for t > To > 0, to G R+. 

Proof of Theorem 3.3: We will only prove the case of strict uniformly asymptotically stabil- 
ity. Suppose that the comparison differential systems in (3.11) is strictly uniformly asymptoti- 
cally stable, then for any given ei, < e\ < S, there exist a S* > such that u w < S* implies 
that Ui(t, To,T7io) < bi(ei) for t > r . 

For this e\ we choose 8\ and Sn, such that ai(S\) < S* and 6\ < e\ where S\ = max{<5i, Sn}, 
then we claim that 



1 1 2/o - Xo\\ < Si, I To - t 1 < 5n imply that ||7/(t, t ,t/ ) - x(t - 77, t ,^o) || < £i for t > r . 

(3.14) 
If it is not true, then there exist t\ and t 2 , t2 > *i > r and a solution ^(t) of 

2' = f(t, z), z(t ) =yo-x for t > T with |t - t | < 8 n and \\y Q - x \\ < Si 

\\y(t, To, 7/0) - x(t - 7/, t , x ) || < <JJ, \\y(t, t , t/ ) - x(t - 7/, t , x ) || = ei and 

5i < ||7/(t,To,7/ ) — a?(t — 77, * , a?o) || < ei for [ti,t 2 ]. 
Choosing /i = S\ and using the theory of differential inequalities we get 
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&i(ei) = b i(\\y(t 2 ,To,yo) -x(t 2 -r),t ,x )\\) 

< Vpfe, y(t 2 , r , y ) - x(t 2 - r], t , x )) 

< r(t 2 , ti, Vp{ti, y(t u t , y ) - x(ti - r], t , x ))) 

< r(t 2 ,*i,Oi(<y;)) 

< r{t 2 ,t u 5*) 

< b^) 

which is a contradiction. Here r(t, To,Uio) is the maximal solution of (3.11). Hence, (3.14) is 
true and we have uniformly stability with initial time difference. Now, we shall prove strictly 
uniformly attractive with initial time difference. 

For any given S 2 , e 2 > 0, S 2 < S* we choose S 2 and e 2 such that 0,1(62) < S 2 and &i(e 2 ) > e. 

For these S 2 and e, since (2.11) is strictly uniformly attractive, for any 6 3 < S 2 there exist 63 

and T\ and T 2 (T 2 < Ti) such that 63 < Uiq = u 2 o < S 2 implies 

r(t,T ,u w ) < r(t,r ,5 2 ) <e 2 
p(t,To,u 20 ) > p(t,T ,5 3 ) > e 2 

where r(t,To,u w ) and p(t, To, 1*20) is the maximal solution and minimal solution of (3.11) (i) 
and (3.11) (ii); respectively. 

Now, for any 63, let b 2 (6 3 ) > ^3- We choose 63 such that a 2 (e 3 ) < e 3 . Then by using comparison 
principle (3.11) (i) and (Ai), we have 

bi(\\y(t,T ,y )-x(t-r],to,xo)\\) < V^(t,y(t, T ,y ) - x(t - rj,t ,x )) 

< r(t,T ,V^To,y -xo)) 

< r(t,T ,ai(\\y -Xo\\)) 

< r(t,r ,5 2 ) 

< e 2 < b x (e 2 ) 

which implies that \\y(t, r , yo) - x(t - 77, t , x ) \\ < e 2 for t G [r + T 2 , r + Ti]. 
Similarly, by using comparison principle in (3.11) (ii) and (A 2 ) we get 

02(||3/(*, to, 2/o) — »(* — »7, *o, a?o)||) > Ve(t,y(t,T Q ,y ) - x(t - rj,t ,x )) 

> p(t,To,Ve(r ,yo-xo)) 

> p(t,r ,b 2 (5 3 )) 

> p(t,T ,5 3 ) 

> e 3 > a 2 (e 3 ) 
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which implies that for \\y(t,To,yo) — x(t — r),to, Xq)\\ > e^ for t G [tq + T 2 ,ro + Ti]. Hence, 
the solution y(t, tq, yo) of the system (2.1) through (to, yo) is strictly uniformly attractive with 
respect to the solution x(t — rj, t , x ) is any solution of the system (2.1) for t > r > 0, t G K+. 
The proof is complete. 
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Abstract 

In this paper we investigate that initial time difference boundedness criteria and Lagrange stability of Fractional 
order differential equations in Caputo's sense are unified with Lyapunov-like functions to establish comparison 
result. We present a comparison result which again gives the null solution a central role in the comparison 
fractional order differential equation when establishing initial time difference boundedness criteria and Lagrange 
stability of the unperturbed fractional order differential equation with respect to the unperturbed fractional 
order differential equation. 

Key Words: boundedness and Lagrange stability, fractional order differential equation, comparison results, 

initial time difference. 

AMS(MOS) subject classification: 34C11,34D10, 34D99. 

1 Introduction 

We have investigated that the Boundedness and Lagrange stability of an unperturbed fractional order differential 
equation with respect to an unperturbed fractional order differential equation with initial time difference. The 
differential operators with the order q (0 < q < 1) are considered in the Caputo's sense ,we have the relations 
among the Caputo, Riemann-Liouville and Griinwald-Letnikov fractional derivatives, and the initial conditions 
are specified according to Caputo's suggestion [1], thus allowing for interpretation in a physically meaningful 
way [4, 7, 10 ]. 

The concept of a Lyapunov function has been employed with great success in a wide variety of investigations 
to understand qualitative and quantitative properties of dynamic systems for many years. Lyapunov' s second 
method is a standard technique used in the study of the qualitative behavior of differential systems [2, 5, 6, 7] 
along with a comparison result [3, 12] that allows the prediction of behavior of a differential system when the 
behavior of the null solution of a comparison system is known. The application of Lyapunov' s second method 
in boundedness theory [5, 6, 7, 14,] has the advantage of not requiring knowledge of solutions. However; there 
has been difficulty with this approach when trying to apply it to unperturbed fractional differential systems [4, 
7, 10 ] and associated unperturbed fractional differential systems with different initial conditions and an initial 
time difference. . The difficulty arises because there is a significant difference between initial time difference 
(ITD) Boundedness and Lagrange stability [8,11-18] and the classical notion of Boundedness and Lagrange 
stability for fractional differential systems [4, 7]. The classical notions of Boundedness and Lagrange stability 
[2, 4, 5, 6, 9,10] are with respect to the null solution, but ITD Boundedness and Lagrange stability [8,11-18] 
is with respect to the unperturbed fractional order differential system where the unperturbed fractional order 
differential system and the unperturbed fractional order differential system differ both in initial position and 
initial time [8,11-18]. 

In this paper, we have dissipated this complexity and have a new comparison result which again gives the null 
solution a central role in the comparison fractional order differential system. This result creates many paths for 
continuing research by direct application and generalization [15, 17, 18, 19]. 

In section 2, we present the basic definitions, fundamental lemmata and necessary rudimentary material. In 
section 3, we have a comparison result in which the stability properties of the null solution of the comparison 
system imply the corresponding (ITD) Boundedness and Lagrange stability properties of the unperturbed 
fractional order differential system with respect to the unperturbed fractional order differential system. 
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2 Preliminaries 

In this section we give relation among the fractional order derivatives; Caputo, Reimann-Liouville and Griinwald- 
Letnikov fractional order derivatives , necessary definition of initial value problems of fractional order differential 
equations with these sense and a comparison result for Lyapunov-like functions. 

2.1 Fractional Order Derivatives: Caputo, Reimann-Liouville and Griinwald-Letnikov 

Caputo' s and Reimann-Liouville's definition of fractional derivatives, namely, 

t 
c D q x = —L-J(t-s)- g x'(s)ds,To<t<T (2.1.1) 




D q x = — - - / (t - s)"- 1 x(s)ds , to < t < T (2.1.2) 



respectively order of < q < 1 , and p + q = 1 where T denotes the Gamma function. 

Fractional derivatives and integrals play an important role in the development of theory of fractional dynamical 
systems [4, 7, 10] Using of half-order derivatives and integrals leads to a formulation of certain real world 
problems in different areas. [3, 11] Fractional derivatives and integrals are also useful in pure mathematics 
and in applications outside mathematics include such otherwise unrelated topics as: transmission line theory, 
chemical analysis of aqueous solutions, design of heat-flux meters, rheology of soils, growth of intergranular 
grooves at metal surfaces, quantum mechanical calculations, and dissemination of atmospheric pollutants. 
The main advantage of Caputo's approach is that the initial conditions for fractional order differential equations 
with Caputo derivative take on the same form as that of ordinary differential equations with integer derivatives 
Another difference is that the Caputo derivative for a constant C is zero, while the Riemann-Liouville fractional 
derivative for a constant C is not zero but equals to D q C = r(i-° 1 — ■ ^ using (2.1.1) and therefore, 

c D q x(t) = D q [x(t) - x(r )} (2.1.3) 

and 

c D"x(t) = DHit) ^f^ (t r () )- 9 . (2.1.4) 

In particular, if x(tq) = 0, we obtain 

c D q x(t) = D q x(t). (2.1.5) 

Hence, we can see that Caputo' s derivative is defined for functions for which Riemann-Liouville fractional order 

derivative exists. 

Let us write that Grunwald-Letnikov's notion of fractional order derivative in a convenient form 

Dlx{t) = lim ±-[ x ( t )-S(x,h,r,q)] (2.1.6) 

where S (x, h, r, q) = \^ ( — l) r ( ) x (t — rh) . If we know that x(t) is continuous and -^-^ exist and inte- 
grable, then Riemann-Liouville and Griinwald-Letnikov fractional order derivatives are connected by the relation 



DMi) . mt) = ^<; : ;f + )y^i<^. (2,-7, 

TO 

By using (2.3) implies that we have the relations among the Caputo, Riemann-Liouville and Griinwald-Letnikov 
fractional derivatives 

t 

c D q x(t) = D q [x(t) x(r )] = Dl [x(t) x(r )] = ^^—^ J (t a)" 9 ^ds. (2.1.8) 

TO 
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The foregoing equivalent expressions are very useful in the study of qualitative properties of solutions of fractional 
differential equations. 

2.2 Fractional Order Differential Equations with Caputo's Derivative 

The main advantage of Caputo's approach to fractional derivative is that the initial values and the notion 
of solution parallels the IVP of differential equations, where the derivative is of order one, that is the usual 
derivative. Since no known physical interpretation of initial conditions in Riemann-Liouville's sense [4, 7,10] 
was available, it was felt the solutions obtained are practically useless. Under natural conditions on x(t) as 
q—>n, the Caputo's derivative becomes the conventional n — th derivative of x(t), for n — 1 < q < n. 
Consider the initial value problems of the fractional order differential equations with Caputo derivative 

c D q x = f(t,x), x(t ) =x for t> t , t €M + (2-2.1) 

c D q y = f(t,y),y(ro) = yohTt>ro,ro€R + (2.2.2) 

c D q uj = H(t, w), w(t ) = yo - X for t > t (2.2.3) 

where xq = lim t ^ to D q ~ l x(i) , yo = lim t ^ To D q ~ 1 y(t) and yo — xq = lim t ^ To D q uj(t) exist and f,H £ 
C[[to,ro+T] x K",K™]; satisfy a local Lipschitz condition on the set R + x S p, S p = [x £ R n : \\x\\ < p < oo] 
and f(t,0) = for t> 0. 

We will only give the basic existence and uniqueness result with the Lipschitz condition by using contraction 
mapping theorem and a weighted norm with Mittag-Lefner function in [7]. 
Theorem 2.3.1: Assume that 

(i) / £ C[R, W 1 } and bounded by M on R where R = [(t, x) : t < t < t + T, \\x - x \\ < b] ; 
(ii) \\f(t, x) — f(t, y)\\ < L \\x — y\\ , L > 0, (t, x) € R where the inequalities are componentwise. 
Then there exist a unique solution x(t) = x(t, to, Xo) on [to, to + a] for the initial value problem of the fractional 

'br( q + 



order differential equation with Caputo's derivative of (2.2.1) where a = min 



T. 



M 



Proof of Theorem 2.3.1, please see in [7]. 

Corollary 2.3.1: Let < q < 1, and / : (to, to + T]x Sp — ► R be a function such that f(t, x) £ L(to, to + T) 

for any x £.Sp. If x(t) £ L(to,to + T), then x(t) satisfies a.e. the initial value problems of the fractional order 

differential equations with Caputo's derivative (2.2.1) if, and only if, x(t) satisfies a.e. the Volterra fractional 

order integral equation (2.2.4). 

Proof of Corollary 2.3.1, please see in [4]. 

We assume that we have sufficient conditions to the existence and uniqueness of solutions through (to,Xo) and 

(to, j/o)- If / S C[[t ,t + T] x M n ,M™] and x(t) £ C q [[t ,T},R] is the solution of (2.2.1), then it also satisfies 

the Volterra fractional order integral equation 

t 

1 f '■ \q-l 



x(t) = x + f^J(t-s) q f(s, x(s))ds, t <t<t +T (2.2 A) 

to 

and that is every solution of (2.2.1) is also a solution of (2.2.4), for detail please see [4]. 

2.3 ITD Boundedness Criteria and Lagrange Stability, Fundamental Lemmata 
and Lyapunov-like Function 

Before we can establish our comparison theorem and Boundedness criteria and Lagrange stability for initial 
time difference we need to introduce the following definitions of ITD Boundedness and Lagrange stability and 
Lyapunov-like functions. 

Definition 2.3.1: The solution y(t, to, Ho) of the initial value problems of fractional order differential equation 
with Caputo's derivative of (2.2.2) through (to, yo) is said to be initial time difference equi-bounded with respect 
to the solution x(t,To,Xo) = x(t — T),to,Xo), where x(t, to,Xo) is any solution of the initial value problems of 
fractional order differential equation with Caputo's derivative of (2.2.1) for t > to, tq £ R+ and 77 = To — to > 
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if and only if for any a > there exist positive functions /3 = /3(t , a) and 7 = 7(t , a) that is continuous in 
to for each a such that 

II 2/0 -sco ||< ol and |to — *o| < 7 imphes || y(t,T ,yo) - x(t - rj,to,Xo) \\< for t > t . (2.3.1) 

If /3 and 7 are independent of To, then the solution y(t, To, yo) of the initial value problems of fractional order 
differential equation with Caputo's derivative of (2.2.2) is initial time difference uniformly equi-bounded with 
respect to the fractional solution x(t — rj,to,Xo). 

Definition 2.3.2: The solution y(t, To, yo) of the initial value problems of fractional order differential equation 
with Caputo's derivative of (2.2.2) through (t , yo) is said to be initial time difference quasi-equi asymptotically 
stable(equi-attractive in the large) with respect to the solution x(t,T ,x ) = x(t — r],to,Xo), where x(t,t ,xo) 
is any solution of the initial value problems of fractional order differential equation with Caputo's derivative of 
(2.2.1) for t > To, To £ R+ and r\ = to — to if for each e > and each a > there exist a positive function 
7 = 7(to, a) and T = T(tq, e, a) > a number such that 

|| ?/o -xo \\< a and |t - to I < 7 implies || y(t,ro,yo) - x(t - rj,to,Xo) ||< e for t>To+T. (2.3.2) 

If T and 7 are independent of To, then the solution y(t,T ,y ) of the initial value problems of fractional 
order differential equation with Caputo's derivative of (2.2.2) is initial time difference uniformly quasi-equi 
asymptotically stable(equi-attractive in the large) with respect to the fractional solution x(t — T],to,Xo)- 
Definition 2.3.3: A function <p{r) is said to belong to the class /C if </> € C[(0, p),K+], <^(0) = 0, and <p(r) is 
strictly monotone increasing in r. It is said to belong to class /Coo if p = 00 and </>(r) — » 00 as r — > 00. 
Definition 2.4.3: For any Lyapunov-like function V(t, x) G C[R + x R",R + ] we define the fractional order 
Dini derivatives in Caputo's sense c D q + V(t,x) and c D q V(t, x) as follows 

c D\V{t,x) = lim + sup^[V(t,x) -V(t-h,x-h q f(t,x))] (2.4.3) 

c D q V{t 1 x) = lim_mi^-[V(t 7 x)-V(t-h,x-h q f(t,x))} (2.4.4) 

for (t,x) eM + xR". 

Definition 2.4.4: For a real-valued function V(t,x) G C[M+ x M",]R + ] we define the generalized fractional 

order derivatives (Dini-like derivatives) in Caputo's sense %DVV{t, y — x) and ^D q V(t,y — x) as follows 

lD q + V(t t y-x) = \im +S np^[V(t,y-x)-V(t-h,y-x-h q (f(t,y)-J(t,x)))} (2.4.5) 

lD q _V{t,y-x) = lim_M^[V(t,y-x)-V(t-h,y-x-h q (f(t,y)-J(t,x)))} (2.4.6) 

for (t,x) eR + xR". 

Lemma 2.3.1: (See [19]) Let / e C[[t ,T] x M",IR n ], and let 

G(t,r) = ^ max || f(t,y) - J(t,x) \\ (2.3.7) 

x,yEB(x ;r) 

where G(t,r) <G C[R+ x R + ,R + ] and B is closed ball with center at xq and radius r. Assume that r*(t,To, \\ 
Vq — Xo || ) is the maximal solution of initial value problem of fractional order differential equation with Caputo's 
derivative c D q u = G(t, u),u(t ) =\\ yo - x || through (t , || y - x ||). x(t,T ,x ) = x(t - r],t ,x ) where 
x(t, to,Xo) is any solution of fractional order differential equation of (2.3.1) for t > to > 0, to € M+ and r\ = To— to 
and y(t,To,yo) is the solution of fractional order differential equation (2.3.2) with Caputo's derivatives. Then 

II y(t,ro,yo) -x(t-ri,to,xo) \\< r*(t,ro, || yo - xo \\) for t > t . 

Lemma 2.3.2: (See [19]) Let V(t,z) £ C[M + x M n ,IR + ] and V(t,z) be locally Lipschitzian in z. Assume that 
the generalized fractional order derivatives (Dini-like derivatives) in Caputo's sense 

lD%V(t, y-x)= km sup hv(t, y-x)-V(t-h,y-x- h q (f(t, y) - /(t, £)))] (2.3.8) 

h— >0 + fV 1 
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satisfies %D q + V{t,y-x) < G(t,V(t,y -x)) with (t,x),(t,y) eR+x R n , where G(t,u) £ C[R + x R + ,R]. Let 
r(t) = r(t,To,Uo) be the maximal solution of the fractional order differential equation c D q u — G(t,u),u(r ) = 
Uo > 0, for t > t . If x(t) = x(t — r\, to, x ) where x(t, to,Xo) is any solution of the system (2.2.1) for t > tq > 0, 
£0 £ R+ and r\ = tq— to and y(t) — y(t,To,yo) is any solution of (2.2.2) for t > tq such that V(jo, J/o~ £0) < ^o 
then F(t, y(£) - x(t)) < r(t) for t > t . 

3 Initial Time Difference Fractional Comparison Results 

In order to have this result we need to use these two Lemmas in [19] 

In this section, we have an other comparison result in which the boundedness and Lagrange Stability properties 
of the null solution of the comparison system imply the corresponding initial time difference boundedness and 
Lagrange Stability properties of the perturbed fractional order differential system in Caputo's sense with respect 
to the unperturbed fractional order differential system in Caputo's sense. 

3.1 ITD Boundedness Criteria and Lagrange Stability 

Theorem 3.1.1: Assume that 

(i) Let V(t, z) £ C[R+ xR",R+] be locally Lipschitzian in z, positive definite and decrescent where the fractional 

order Dini derivatives in Caputo's sense c D+m(t) 

c D q + m{t) < Jim sup ±[V(t, y-x)-V(t- h, (y-x)- h?(f(t, y) - J(t, x)))} 

satisfies lD\V(t, y-x) < G(t, V(t, y - x)) for (t, x) and (t, y) £ R+ x R n , where G(t, u) £ C [R+ x R+, R] and 
the generalized fractional order (Dini-like) derivatives in Caputo's sense 1D q + V(t,x), 
(ii) Let V(t, x) be positivedefinite such that 

Kll x II) < V(t,x) with (t,x) £K + xM" (3.1.1) 

and b £ JC. b(u) — ► 00 as u — > 00 on the interval < u < 00; 

(iii) Let r(t) = r(t, ro,Uo) be the maximal solution of the fractional order differential equation with Caputo's 

derivative 

c D g u = G(t, u), u{t ) = u >0foit> to. (3.1.2) 

Then the initial time difference boundedness properties of the null solution of the fractional order differen- 
tial system with Caputo's derivative (3.1.2) with G(t, 0) = imply the corresponding stability properties of 
y(t,To,yo) any solution of fractional order differential system with Caputo's derivative (2.2.2) with respect to 
x(t, To, xo) = x(t—rj, to, Xo) where x(t, to, xo) is any solution of fractional order differential system with Caputo's 
derivative of (2.2.1). 

Proof: Let a > and To <G R+ be given, and let || y — Xq ||< a and |t — to\ < 7 for 7(to, a) > 0. In view of 
the hypotheses on V(t,x), there exists a number U\ = a\{To,(x) > satisfying the inequalities 

II 2/o - a^o ||< a and |t - to I < 1, V{ro,yo - Xo) < «i 

together. Assume that comparison system (3.1.2) is equibounded. Then, given ai > and t <G R+ there 
exist & Pi = /3 1 (to,ck) > that is continues in To for each a such that 

r(t,To,uo) < @i provided Uo < (Xi- (3.1.3) 

Moreover, as b(u) — > 00 as u — > 00, .we can choose a L = L(to, a) verifying the relation 

b{L)>^{To,a) (3.1.4) 

now let uo = V{ T o,yo — xo)Then assumption (i) and Lemma 2.3.2 show that 

V(t, y(t, T , yo) - x(t - 77, to, x )) < r(t, t ,u ), t > t (3.1.5) 
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where r(t, To, Wo) is the maximal solution of comparison equation (3.1.2). Suppose, if possible, that there is 
a solution of system (2.2.3) co(t, to, Wo) = Z/(£, T o,2/o) — x{t — rj,t ,xo) for t > t with || y a — ^o II < <* and 
l T o — ^o I ^ T having the property that, for some t\ > To, || y{t, To, J/o) ~~ x(t,To,x \\= L 
Then because of relations (3.1.1), (3.1.3), (3.1.4) and (3.1.5), there results oddity 

K L ) < V(ti,y(h,To,yo) -x(h,T ,xo)) < r(ii,T ,wo) < /?i( T o,a) < &(£) 

then 

II y(t,T ,yo) -x(t,T ,X \\< L(r ,a) provided || y - x \\< a and |r — *o I < 7- 

These completes the proof. 

Theorem 3.1.2: Let the assumption of Theorem 3.1.1 holds. Then the initial time difference quasi-equi 
asymptotically stable (equi-attractive in the large) properties of the null solution of the fractional order differ- 
ential system with Caputo's derivative (3.1.2) with G(t, 0) = imply the corresponding initial time difference 
quasi-equi asymptotically stable properties of y{t,ro,yo) any solution of fractional order differential system 
with Caputo's derivative (2.2.2) with respect to x(t, tq,xq) = x{t — rj, £o,^o) where x(t, to,Xo) is any solution of 
fractional order differential system with Caputo's derivative of (2.2.1). 
Proof: We want to prove the theorem by considering Definition 2.3.2 

Let e > 0,a > Oand To £ K+ be given .and let || yo — xq \\< a and |to — io| < 7 f° r 7( T o, ct) > 0. As in the proof 
in theorem (3.1.1), there exists a a± = ai(ro,a) satisfying 

II 2/0 - %0 II < a, V(ro,yo - %o) < «i 

simultaneously. Since for comparison system (3.1.2) is quasi-equi asymptotically stable (equi-attractive in the 
large). Then, given «i > ,b(e) and t € K+ there exist aT = T(r n ,a, e) such that 

II uq ||< «i implies r(t,To,wo) < fe(e), for t > t +T. (3.1.6) 

Choose uq = ^(to, j/o ~~ xo).Then assumption (i) and Lemma 2.3.2 show that 

V(t,y(t,T ,y ) -x(t-r],to,Xo)) < r(t,T ,u ),t > t . (3.1.7) 

If possible, let there exist a sequence {£&} , 

tk > To + T, tic — > °° as k —* oo 

such that, for some solution of system (2.2.3) w(i,To,wo) = y(t, to,j/o) — x(t — rj,tQ,xo) for t > tq with 
|| j/o — x o || < or and |to — iol < 7 f° r 7( T o, a) > we have 

II y(t,ro,yo) -x(t,ro,xo || > e 

this implies, in view of the inequalities (3.1.1), (3.1.6) and (3.1.7) 

b( e ) ^ V(tk, y(tk, to, J/o) - *(<*;, T , x )) < r(t kl T , Mo) < 6(e) 

which proves 

|| y(t,To,yo)-x(t,To,Xo ||< e for t > To+T(ro,e,a) provided || yo~x \\< a and |t - *o| < 7 f° r 7( T o,a) > 0. 

Therefore, these completes the proof. 

Theorem 3.1.3: Let the assumption of Theorem 3.1.1 holds as 

(i) Let V(t, z) <G C[R+ xR n ,R+] be locally Lipschitzian in z, positive definite and decrescent where the fractional 

order Dini derivatives in Caputo's sense c D q ^m{t) 

c D q + m{t) < lim sup ±- [V(t, y-x)-V(t- h, (y-x)- h?(f(t, y) - }(t, x)))] 

satisfies %D\V(t, y-x) < G(t, V{t, y - x)) for (t, x) and (t, y) g K+ x W 1 , where G(t, u) g C [R+ x K+, K] and 
the generalized fractional order (Dini-like) derivatives in Caputo's sense %DVV{t, x); 
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(it) Let V(t, x) be positivedefinite such that 

Kll x II) < V(t,x) with (t,x) £l + xl" 

and b £ JC. b(u) — ► oo as u — ► oo on the interval < u < oo; 

(in) Let r(i) = r(t, to,Wo) be the maximal solution of the fractional order differential equation with Caputo's 

derivative 

c D q u = G(t,u), u{t ) = u > for t > t . 

Then the initial time difference Boundedness and Lagrange stability properties of the null solution of the 
fractional order differential system with Caputo's derivative (3.f.2) with G(t, 0) = imply the corresponding 
stability properties of y(t, To,yo) any solution of fractional order differential system with Caputo's derivative 
(2.2.2) with respect to x(t, To, Xo) = x(t — r], to,Xo) where x(t, to,Xo) is any solution of fractional order differential 
system with Caputo's derivative of (2.2.1). 

Proof: We know that equi-Lagrange stability requires the equi-boundedness and equi-attractive in the large. 
We proved in Theorem 3.1.1 and Theorem 3.1.2, respectively. Then the proof of Theorem 3.1.3 is complete. 

3.2 ITD Uniformly Boundedness Criteria and Lagrange Stability 

Theorem 3.2.1: Assume that the assumptions of Theorem 3.1.1 holds. In addition to hypotheses of Theorem 
3.1.1, let V(t, x) verify the inequality 

V(t,x) < a(\\ x ||) with (t,x) el + xR" (3.2.1) 

where, a £ /C. a(u) — ► oo as u —* oo on the interval < u < oo. 

Then, if fractional order comparison system (3.1.2) is uniformly bounded, the solution y(t,To,Vo) of (2.2.2) 

through (ro, 2/o ) is initial time difference uniformly bounded for t > to S M+ with respect to the solution 

x(t — r],t ,xo) of (2.2.1) through (to,Xo) where x(t, to,Xo) is the solution of (2.2.1) through (to,xo). 

Proof: Let a > and tq € M. + be given, and let || j/o — ^o ||< ot and \tq — to\ < 7 for j(tq, a) > 0. In view of 

the hypotheses on V(t, x), there exists a number a,\ = a(a) > satisfying the inequalities 

II Vo -xq II < a, V(to,Vo -xo) < <x\ = a(a) 

together. Assume that fractional order comparison system (3.1.2) is uniformly equibounded. Then, given 
u\ > and to <G R+ there exist a /3 1 = /3 1 (a) > that is continues in to for each a such that 

r(t,To,Uo) < Pi provided uq < Oi\ (/3j and ot\ are independent of To). (3.2.2) 

Moreover, b(u) — ► oo as u — ► oo,.we can choose a L = L(a) verifying the relation 

&(£)>/3i(a) (3.2.3) 

now let uo — ^ / ( r o,?/o — ^o)- Then assumption (i) and Lemma 2.3.2 show that 

V(t, y(t, t , y ) - x(t - 77, t , x )) < r(t, t , u ), t > t 

where r(t, To,tto) is the maximal solution of comparison equation (3.1.2). Suppose, if possible, that there is 
a solution of system (2.2.4) cj(t,To,wo) = y(t,To,yo) — x(t — r),to,Xo) for t > tq with|| j/o — x o ||< a and 
|to — io I ^ 7 having the property that, for some t\ > To, 

II y(t, To, Vo) - x(t, T , Xo ||= L 
is independent of To- Then because of relations (3.1.1), (3.1.5), (3.2.2) and (3.2.3) , there results contradiction 

b(L) < V(ti,y(ti,To,yo) -x(h,To,xo)) < r(<i,ro,«o) < 0i(oe) < b(L). 
Therefore, 

|| y(t,To,yo) - x(t,T ,x || < L(a) provided || y - x \\< a and |t — *o| < 7 for i > t . 
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These completes the proof. 

Theorem 3.2.2:Assume that the assumptions of Theorem 3.2.1 holds. Then, if fractional order comparison 

system (3.1.2) is uniformly quasi-equi asymptotically stable (equi-attractive in the large), the solution y(t, to, yo) 

of (2.2.3) through (ro,2/o) is initial time difference uniformly quasi-equi asymptotically stable (equi-attractive in 

the large) for t > tq £ R+ with respect to the solution x(t — f], to, Xo) of (2.2.1) through (to,Xo) where x{t, to, Xo) 

is the solution of (2.2.1) through (to,xo). 

Proof: We want to prove the theorem by considering Definition 3.3.2 as independent of To- Let e > 0, a > 

and t~o £ K+ be given .and let |j yo — ^o ||< ol and |ro — to I < 7 for 7( T 07 a ) > 0. As in the preceding proof, 

there exists a ot\ = a(a) satisfying 

II yo -Xo || < a, V(ro,yo - x ) < tti 

simultaneously. Since for comparison system (3.1.2) is equi-attractive in the large. Then, given a.\ > 0, b(e) > 
and To € R+ there exist aT = T{pc, e) such that 

II uo || < ct\ implies r(t,To, uq) < b(e) for t > to + T. (3.2.4) 

Choose Mo = V(t , yo — Xo). Then assumption (i) and Lemma 2.3.2 show that 

V(t, y(t, T , y ) - x(t - i], t ,x )) < r(t, t , Uo), t> Ta- 
li possible ,let there exist a sequence {£&} , 

tk ^ T o + T, tk — * oo as k — > oo 

such that, for some solution of system (2.2.3) ui(t, to,Wo) = y(t, to,J/o) — ■' E (t — ??, ic^o) for £ > to with 
|| yo — xq ||< a we have 

II y(t, t , yo) - x(t,T ,x || > e 
this implies, in view of the inequalities (3.1.1), (3.1.5) and (3.2.4), we obtain 

b(e) < V(t k ,y(t k ,T , y ) - x(t k , t , x )) < r(t k , t , Uo) < b(e) 

which proves 

|| y(t,T Q ,yo) - x{t,To,xo ||< e provided || y - x ||< a and |t — *o| < 7 for t > t +T(e,a). 

Therefore, these completes the proof. 

Theorem 3.2.3: Assume that 

(i) Let V(t, z) £ C[M+ xR n ,R+] be locally Lipschitzian in z, positive definite and decrescent where the fractional 

order Dini derivatives in Caputo's sense c D^_m(t) 

c D\m{t) < lim sup ±-[V(t, y-x)-V(t- h, (y-x)- h?(f(t, y) - /(*, x)))] 

satisfies %D\V{t, y-x) < G(t, V(t, y - x)) for (t, x) and (t, y) £ R + x R n , where G(t, u) £ C [R+ x R + , R] and 
the generalized fractional order (Dini-like) derivatives in Caputo's sense %D+V(t, x); 
(ii) Let V(t, x) be positivedefinite such that 

Kll x II) < V(t,x) < a,(|| x ||) with (t,x) eR + xR" (3.2.5) 

and a,b £ JC. b(u) — ► 00 as u — > 00 on the interval < u < 00 and a(u) — ► 00 as u — > 00 on the interval 

< u < 00; 

(Hi) Let r(t) = r(t, to,Uo) be the maximal solution of the fractional order differential equation with Caputo's 

derivative 

c D q u = G{t,u), u(t ) = uo > for i > tq. 

Then the uniform-Lagrange stability properties of the null solution of the fractional order differential system 
with Caputo's derivative (3.1.2) with G(t,0) = imply the corresponding uniform-Lagrange properties of 
y(t, To,yo) any solution of fractional order differential system with Caputo's derivative (2.2.2) with respect to 
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x(t, To, xq) = x(t — r], to, Xo) where x(t, to, Xq) is any solution of fractional order differential system with Caputo's 

derivative of (2.2.1). 

Proof: By using the Theorem 3.2.1 and the Theorem 3.2.2 we have that the uniform boundedness and uniform 

attractive in the large of comparison system (3.1.2) imply the corresponding uniform boundedness and uniform 

attractive in the large of y(t, tq, j/o) of perturbed differential system of (2.2.2) that differs in initial position and 

initial time with respect to the solution x(t — rj,to,xo), where x(t, to,Xo) is any solution of the unperturbed 

differential system of (2.2.1). These completes the proof. ■ 
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Abstract. In this paper, we have investigated the monotone iterative technique that is used to obtain the 
minimal and maximal quasisolution for the first order initial value problem in finite systems assuming that right 
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1 Introduction 

The original method of monotone iterative techniques provides an explicit analytic representation for the solution 
of nonlinear differential equations, which yields pointwise upper and lower estimates for the solution of the prob- 
lem whenever the functions involved are monotone nondecreasing and nonincreasing [1, 3]. The most important 
applications of this method has been applied to obtain a sequence of lower bounds which are the solutions of linear 
differential equations that converge uniformly and monotonically [1, 3]. As a result, the method has been popular 
in applied areas [3, 4]. Recently [1] , this method has been generalized, refined and extended in several directions 
so as to be applicable to a much larger class of nonlinear problems by demanding monotonicity property. Moreover, 
other possibilities have been explored which make the method of monotone iterative techniques universally useful 
and fruitful in applications [3]. 

In this paper, the monotone iterative technique is extended to finite systems assuming that right hand side 
is sum of two monotone functions. This technique used to obtain upper and lower sequences in terms of the solution 
of linear differential equations and bound the coupled quasisolutions of a given nonlinear differential equation. It 
is also shown that these sequences converge to the coupled quasisolution of the nonlinear equation uniformly and 
monotonically. 

2 Basic Definitions and Theorems 

In this section we will give some basic definition and Theorems which are very useful to use our future references. 
We consider the differential system 

u' = f (*,«), u(t ) = u (2.1) 

where / G C [J x K™, W 1 ] and J = [t , t + T\. 

Definition 2.1: A function / £ C [J x R",R"] is said to be quasimonotone nondecreasing (nonincreasing) if, for 
some i such that 1 < i < n, u < v and m — u,, fi (t, u) < fi (t, v) , (fi (t, u) > fi (t, v)) for t € J. 

Definition 2.2: A function / £ C [J x E™,K™] is said to possess mixed quasimonotone property if for each i 

such that 1 < i < n, fi (t,Ui, [u] , [u] ) is monotone nondecreasing in [u] and monotone nonincreasing in [u] 

where Pi + qi = n — 1 . 

Let us consider the initial value problem as follows 

u' = f {t,u) + g (t,u), u(to) = u (2.2) 

where f,g& C[J xW\W 1 }. 
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Definition 2.3: The functions a,/3 <G C 1 [J, M. n ], to,T > are said to be coupled lower and upper solutions of 
(2.2) if a and {3 satisfy the differential inequalities 

a <f (t, f3 (t)) +g(t,a (t)) , a (to) < u (2.3) 

(3' > f (t, a (t)) +g(t,/3 (t)) , (3 (to) > u . (2.4) 

The following Theorem 2.1 is an extension of [3, Theorem 1.1.1] to systems. Please see [3] for the proof of the 
following Theorems. 

Theorem 2.1: Let v,w <G C 1 [J, M. n ] be lower and upper solutions of (2.1) respectively. Suppose that / is 
quasimonotone nondecreasing and for each i 

n 

f i (t,x 1 ,...,x n )- fi(t,yi,...,y„)<Li^2(xi-yi) (2.5) 

whenever x > y and Li > 0, t £ J. Then V (to) < w (to) implies v (t) < w (t) on J. 

Theorem 2.2: Let v 7 w <G C 1 [J,R™] be lower and upper solutions of (2.1) such that v (t) < w (t) on J and let 
/ £ C[f2,R n ] where 

fi = [(*, «)6JxR":f)(i)<ii(()<ii) (t)] 

then there exists a solution u of (2.1) such that v (t) < U (t) < w (t) on J provided v (to) < U (to) _! w (*o) • 
Theorem 2.3: Let us consider the initial value problem as follows 

u' t = ft (t, m, [u] pi , [u] q ) , u (to) = uo (2.6) 

/ £ C [J x R ra ,R n ] possess mixed quasimonotone property and let Vo,Wo be coupled lower and upper quasisolutions 
of system (2.6) such that vo < wo on J. Suppose further that 

fi (t, Ui , [u) pi , [u] J - fi (t,Zi, [u} pi , [u] qt ) > -Mi (t) ( Ui - u t ) (2.7) 

whenever vo < U < wq and for each % = 1,2, ...n, Woi _: W» < U, < u»oi and Mj > 0. Then there exist monotone 
sequences {f n } , {w n } such that w„ — ► v, w n ->toasu->oo uniformly and monotonically to coupled minimal and 
maximal quasisolutions of (2.6) on J provided vq (to) < uq < Wo (to) • Further if u is any solution of (2.6) such that 
t>o < u < wo then v < u < w on J. 

Theorem 2.4: Let a, (3 <G C 1 [J, M n ] be coupled lower and upper solutions of (2.2) respectively. Suppose that / 
is quasimonotone nondecreasing and g is quasimonotone nonincreasing in x for each t, and for each i 



Fi (t, x(t),y (t)) - F t (t, x(t),y (t)) < Li 



^2(xi(t)-Xi(t)) + (yi(t)-yi(t)) 



(2.8) 



whenever x(t) > x (t) , y (t) > y (t) and where Li > and F t (t,x (t) ,y (t)) = fi(t,(xi,...,x n )) + g t (t, (y lt ..., y n )) . 
Then a (t ) < 13 (t Q ) implies that a(t)</3 (t) for t G [t ,t + T] . 
Proof : We first prove the theorem for strict inequalities. We suppose that 

/?' >f(t,a) + g(t,(3), a <f(t,(3)+g(t,a), teJ 

and a (to) < (3 (to) ■ 

We shall prove that a (t) < (3 (t) , t <G J. Suppose the conclusion is not true. Then the set 

n 

Z={J{teJ:P t (t)<ai (t)} 

2=1 

is nonempty. 
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Let t\ = mi Z. Certainly t\ > 0. Since Z is closed, i x G Z and consequently there exists a j such that 
ft (£1) = ctj (ti) and Qj (£) < ft (£) for £ G [£ ,£i) . Moreover Qj (ti) > ft (£1) for i 7^ j. Hence, we have for small 
h > 

aj (ti - /i) - a,- (£1) < ft (£1 - ft) - ft (£1) • 

That implies, c^ (£1) > ft (£1) . This, together with the quasimonotonicity of /, yields 

fj (*i>ft (^i),/3 2 (ii),---,/3„(ii)) +5j (<i,«i (*i),Q!2(<i),-,Q!n(*i)) 

> ft(*i) 

> fj(tu<xi (t 1 ),a 2 {t 1 ),...,a n (t 1 )) +gj (£i,ft (£1) ,ft (£1) , ...,/3„ (£1)) 
= fj (h,oti (h) ,012 (h) , ..., fij (h) , ...,a n (ti)) 

+9j (*i, ft (h) , ft (*i) , •••, cxj (h) , -, ft, (£1)) 

> fj(ti>0i ( t i),P 2 {ti),-;f3 n (t 1 )) +g 3 (ii,«i (ii),a2(<i),...,a„(ti)) 

which leads to contradiction. Therefore, we have proved that a (£) < /3 (£) , £ € J. 

In order to prove the case of nonstrict inequalities, consider functions for each i and e > 

a t (£) = a t (£) + ee {2n+1 ^ Lt and ft (£) = ft (£) + ee ( 2 "+ 1 ) L « 
where L = max {Li > : i = 1, 2, ...,n} . 

ft(£) = ft (£) + e (2n + 1) Le ( - 2n+1 '> Lt 

> fj (ti,ai (£1) ,a 2 (£i),-,a„(£i)) 

+&■ (*!,/?! (£1) , ft (£1) , ..., /3„ (£1)) + e (2n + 1) Le( 2 " +1 ) Lt 

> F 4 (i, 5 (£) , £ (£)) - L^nXe* 2 ""^" + eLe ( - 2n+1 '> Lt + e2nLe^ n+1 '> Lt 

> ^(t, 5 (*),£(*)) 

= fi(t, ai (£i),5 2 (£i),...,S„(£i)) + 3j (*i,ft (*i),ft (*i) > ->fti (*i)J ■ 

Also tti (£0) < ft (£0) < ft (£0) • Now using the result corresponding to strict inequalities we get 

a t (t)< ft (£)= ft (£)+ ee ( 2 " +1 ) Lt 

for £ <E J. 

Letting e — ► 0, we now obtain the required result a, (£) < ft (£) for £ G J. The proof is completed. 

3 Main Results 

In this section we will give necessary definitions and then the our main results. 

For each fixed i, 1 < i < n let Pi,qi be two nonnegative integers such that 1+ pi + qi = n so that we can split 
the vector u into (u i: [u] , [u] J . Then the system (2.2) can be written as 

u'i = fi (t,Ui, [u] p . , [u] q .) + g t (t,Ui, [u] pi , [u] q ) , u (£ ) = «o- (3.1) 

Definition 3.1: The functions a ,/3 G C 1 [J,R n ] and f,g G C [J x E",K™]. Then a ,ft are said to be coupled 
lower and upper quasisolutions of (3.1) if they satisfy 
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«o,i ^ fi (*,«<),», [ao] p . , \fio\ qi ) + 9i (*./3o,». [^o] Pi » M g J , "o (to) < uo (3.2) 

/3'o,i > fi (*> A),i) [^o] P , . [«o] g J + 3i (*, ao,;, [ao] Pi , [A)] gi ) > £o (*o) > «o- (3.3) 

Definition 3.2: Let a,/3 € C 1 [J,R n ] and /,p G C[JxM n ,l n ]. Then a and /3 are said to be coupled 
quasisolutions of (3.1) if 

a 'i = ft f *) «*) M Pi , \0\ q A + 9i (t, Pi, \0\ p . , [a] q .) , a (to) = u (3.4) 

# = fi (t,p i ,[p) pi ,[a] q .)+ 9i(t,ai,[a] pi ,[j3Q, P(t ) = u . (3.5) 

Theorem 3.1: Let ao and /3 be the coupled lower and upper quasisolutions of (3.1) such that cxq (t) < 
/3 (t) , t £ J. For each i, /j It, m, [u] , [u] J is nondecreasing in u; and [u] and nonincreasing in [u] and 

</i ( i, Ui, [u] , [u] ) is nonincreasing in u% and [u] and nondecreasing in [it] , then there exists monotone sequences a, 



a and /3 n — ► ,5 as n — > oo, uniformly and monotonically to coupled quasisolutions of (3.1). 
Proof: Let us consider the following linear system of differential equations 

«fe+i,» = fi (t,ak,i, [oik] Pi , \Pk\q-) + 9i (*./3fe,i' t^felpi ' [ afe ]<?J ' afc +! (*«) = "o ( 3 - 6 ) 

/^fe+i,. = fi (*.^fc,i> [/3fc] P , » K] 9 J + ft (*.Q!fe,»i K] Pl ' t^fclgj ' ^fe+i (*o) = «o (3.7) 

for ? = 1,2, ...,n and fc = 0,1,2,3,.... The solutions of linear system (3.6) and (3.7) exist on J. To show that 
ot\ it) > a (t) we set pi (t) = ot\^ (t) — ao,i (t) for t € J, pi (t ) > 0. Then 

Pi (t) = "i,, (*) - «0,i (*) 

> /« (*, «o,i, [«o] Pi , [/3 ] 9 ,) + 9i (t, /3 0)i , [^ ] P , . M g J 

- /» (i.ao.i, M Pi , [A)] g J - ft (*, £o,i> \Po] Pi > M g J 
= 

which implies J9j (£) > for z = 1,2, ...,n and hence «i (£) > ao if) for t £ J. Similarly, we can show that f3 1 (t) < 
f3 Q (t) on J. To show (3± (t) > <x\ (t) we set Pi (t) — fi li (t) — a>i t i (t) , pi (t ) > 0. So that 

Pi(t) = 4(*)-ai,i(t) 

= /« (*, ^o,ii I^o] Pi i [ a o] qi ) + 9i (t, a ,u [a ] Pz , [/3 ] g . J 

- /» (t.ao.i, I a o] Pi , [/?o] g J - 9i (t,P 0ii , [P ] Pt , [ao]q.J 

> fi (t,ato,i, [a ] pt , [/3 ] Q .J + 3l ^,/3 0)i , [/3 ] p . , [a ] g .J 

- /» ^,Q!o,i, [a ] Pi , [/?o] g J - 5i (*, Am> [^o] Pi > [ a o] qt J 
ft (i) > 

since / is nondecreasing in Uj and [u] and nonincreasing in [u] and g is nonincreasing in tij and [u] and 
nondecreasing in [u] . Then p^ (i) > for i = 1, 2, ..., n and hence i 9 1 (i) > ai (t) for f G J. Hence we have 

ao (t) < «i (t) < $ x (t) < /3 (t) on J. (3.8) 
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Now, assume that for some k > 1 

«o (t) < a fe _i (t) < a k (t) < P k (t) < $ k _ t (t) < /3 (t) on J (3.9) 

We want to show that 

a k (t) < afe+i (t) < /3 fe+ i (t) < /3 fc («) on J (3.10) 

To prove this, we let pi (t) = Ot, k +i,i {t) — oi k> i (t) clearly that Pi (to) = O.Thus we have 

Pi (*) = °4+M (*) - a M (*) 

= fi [t, a k ,i, [a k ] p . , [0 k ] g . j + 9i [t, k>i , [0 k ] p . , [a k ] q .J 

> fi [t,a k -i,i,[a k -i] p . , [/?fe-i] g J - 9i \t,Pk-i,n [Pk-i] Pi >[ a k-i] qi ) 
-/» ^,afc-i,i, [afe_i]p. , [/3fe_i] g J - 3» (*.^fc-i,»i [^-i] Pi >K-i],,) 
Pi(*) > 

since / is nondecreasing in m and [u] and nonincreasing in [u] and g» is nonincreasing in m and [u] and 
nondecreasing in [«]_.. Then p, (t) > for i = 1, 2, ..., n and hence ctfe+i (£) > «& (t) for t € J. To show that we set 
Pt (*) = Pk+i (*) - P k \t) for t e J and Pl (t ) < 0. 

Piit) = 0'k+i(t)-0k(t) 

= fi (t, P k ,i, [P k ] Pz , [®k] qi ) + 9i (t, a k ,i, [a k ] p% , [0 k ] qi ) 

-ft (*>/3fc-i,») [Pk-i] Pi . K-i] g J - 3i ^,afc_i,i,[a fc _i] p . , |A-i] q J 
< /» [t,p k _ ll , [/3 fe _i] p . , [a fe -i] q J - 5i^,afe_i,i,[afc_i] p . , [/3 fc _i] g J 

-/» (i.^fc-i.i! [/3fe-i] Ps »K-i] qi ) - 3i (i,afc-i, 4 ,K-i] p , , [Pk-i] qi ) 

Pi(t) < 

since / is nondecreasing in m and [u] and nonincreasing in [u] and <? is nonincreasing in u, and [u] and 
nondecreasing in [u] Then p, (£) > for i = 1, 2, ..., n and hence (3 k+1 (t) < f3 k (t) for t € J. 
To show that we set p, (t) = /3 fc+1 j (t) — afc+i,i (t) for t <G J and Pi (to) > 0. 

Pi (*) = /3fe+i,i (*) - aL+i,i 0) 

= /i (*, ^fc,i, [/5fe] Pj i [afelgj + m (*> Q!fe,i, [afe] p . , [/3fc] gi J 

-/i (t,a M , [a fc ] p . , [/3 fc ] q J - 3» (*,^fc,i' t^felps ' [ afc ]<7.) 
> /» (*, a k ,u ["fc]p, , [/3fe] 9 J + 9t (t, k>i , [f3 k ] K , [ak} qi ) 

-ft (t, a k ,u [ak] Pt , \Pk\ qi ) - 9t (t, P kt i, \P k ] Pi > \ a k} q /j 
p'iit) > 

since / is nondecreasing in m and [u] and nonincreasing in [u] and g is nonincreasing in Ui and [u] and 
nondecreasing in [u] . Then p, (t) > for i = 1, 2, ..., n and hence f3 k+1 (t) > a^+i (t) for t £ J. Hence by induction 
(3.9) is valid for all n. Thus we have the monotone sequences such that 
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a k +i,i =u + i fi ($, a k ,i, [a k ] Pi , [P k ] q A + ft [s, /3 fe)i , [p k ] p . , [a k ] q .) J ds (3.13) 

J to 

a t (t) = u + J { /i (a.aj, [a] Pj , [/9], ( ) + ft (a, fit, [P] Pi , [a] qi )]ds (3.14) 



«o (t) < Qi (t) < « 2 (t) < ... < a„ (t) < ft, (t) < ... < ft (t) < ft (t) < ft (t) for t e J. (3.11) 

By the standard argument [3], there exist monotone sequences {a n (£)} and {/?„ (£)} such that a n — ► a and 
/3 rl — > p as n — > oo uniformly and monotonically to coupled minimal and maximal quasisolutions of (3.1). 

It is now easy to conclude that the sequences {a k (£)} and {p k (£)} coupled minimal and maximal quasisolutions 
of (3.1). 

a 'k+i,i = fi (*.«M) t a fe] Pi « [ft] gi J + 9i (t,Pk,ii [Pk\ Pi . ["felqj i "fc+i (*o) = u (3.12) 

then 



and for k — ► oo 



consequently, 

«, (*) = /* («,<*»> [a] p . , [/%) + ft (s,ft, [P] Pi , [a] q .J , a (to) = « - (3-15) 

Similarly we can show that 

ft (*) = fi (*, ft, [ft Pi , [<*]„) + ft («, «i, M Pi , [ft 1 J , p k+1 (t ) = uo (3.16) 

then a (t) and p (t) coupled quasisolutions of (3.1). This completes the proof. 

Corollary 3.1: Let ao and P be the coupled lower and upper quasisolutions of (3.1) such that ao (t) < u(t) < 
ft (t) , t £ J. / is nondecreasing in Ui and [u] and nonincreasing in [u] and g is nonincreasing in «j and [u] 
and nondecreasing in [u] , then there exists monotone sequences a n — > a and P n — > /3 as n — ► oo, uniformly and 
monotonically to coupled maximal and minimal quasisolutions of (3.1). Further if u is any solution of (3.1) such that 
a (t) <u(t)< p (t) then a(t) <u (t) < P (t) on J. 

Proof: Let {u\ (t) , Ui (t)} be any coupled quasisolution of (3.1). Let assume that for t G J and k € Z, Ot k -i (£) < 
ui (t) and ^ fc _! (t) > u 2 (t) . Set 

K (t) - CXk,i (t) - u M (t) , ^ (t ) = 0. 

Pi (t) = a 'k,t (t) - W M (*) 

= fi (t, a k -i,i, [otk-i] Pi , [Pk-i] q J + ft (*i ft-i,;, [ft-i] Pt . [ a fc-i] 9 J 

- /» fi,Ml,i, [«l] p . , [«2] g J - ft (*,«2,i, M Pi . [ U l]gJ 
< /i (*, Ul,i, [Wl] p . , [u 2 ] q . J + ft U, U 2> i, M p . , M g J 

- /» (t,Ul,i, [Ul] p . , [U2] q .J - ft (i,W2,i, M Pi , [«l] g J 

Pi(t) < o 

since / is nondecreasing in m and [u] and nonincreasing in [u] and g is nonincreasing in u t and [u] and 
nondecreasing in [u] . Then p^ (t) > for i = 1, 2, ..., n and hence a^+i (t) > a k (t) for t £ J. Similarly, the setting 
for t e J 

Pi (t) = PkA (*) - u 2,t (t) , Pi (to) = 0. 
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Pi(t) = fi'k.i (*) " *4,< (*) 

= /* (*.^fc-i,i) [^fc-i] Pi >[ a fc-i] gi ) + ft ^,afc-i,i,[afc-i] Pj , [/3fc-i] q J 

- /i ft, U2,», [u 2 ] p . , [ui] q .J - ft (*, "l,i, M p . , [ u 2\ q . J 
> /i (*, «2,», M pi , [«l]gj + ft (*, «l,i) M P , . MgJ 

- /» U,M 2 ,i, M pi , [«l] g J - ft f*,«l,», [«l] Pi . MgJ 

Pi(t) > o 

since / is nondecreasing in Wj and [u] and nonincreasing in [u] and g is nonincreasing u, and [it] and nondecreasing 
in [u] . Then Pi (i) > for i = 1, 2, ..., n and hence a^+i (t) > au {t) for t € J. It follows by induction that a^ (i) < 
Ui (£) and ft. (t) > u 2 (t) on J. Then a (i) < U\ (t) and /3 (£) > u 2 (t) on J for k — ► oo proving {ui (£) , W2 (£)} are 
coupled minimal and maximal quasisolutions of (3.1). Since any solution u of (3.1) such that ao(t) < u(t) < 
ft (t) can be considered as {u (t) , u (t)} coupled quasisolutions of (3.1) we also have a (t) < u (t) < fJ (t) for t £ J. 
This completes the proof. 

Definition 3.3: Let a, (3 <G C 1 [J, W 1 ] and f,g£ C [J x K", K™]. Then a, ft are said to be coupled quasisolutions 
of (3.1) if they satisfy 

ot\ = fi (t, ft, [ft Pi , [a] J + 5 , (*, a<, [a] w , [ft 1 J , a (to) = «o (3.17) 

0i = /i (*, <*i, H Pi . [ft 1 J + ft (*, ft, [ft Pl , M J , /3 (to) = t*o (3-18) 

Remark 3.1: Let ao and f3 be the coupled lower and upper quasisolutions of (3.1) such that ao (t) < ft (t) , t <G 
J. / is nonincreasing in Uj and [it] and nondecreasing in [it] and g is nondecreasing in Ui and [it] and nondecreasing 
in [u] then there exists monotone sequences such that «o < aiand ft > ft, ct„ — > a and /3 n — ► (3 as n — > 
oo, uniformly and monotonically to coupled quasisolutions of (3.1). 

Proof: Let us consider the following linear system of differential equations 



M 



fc+M = fi (*>^fc,»' \Pk] Pi » K]<7.) + ft (*.«!fe,i) K] Pl > [^fc] 9i ) ' "fe+1 (*o) = Wo (3.19) 

P'k+hi = fi (*> "W. M P , - 1/ 3 *] J + ft (*> /3 fc ,i, [ftJ Pi , [(*k] qi ) , /3 fc+ i (to) = u (3.20) 

for i = 1,2, ...,n and fc = 0,1,2,3,.... We proceed very much similar to Theorem 3.1, then we obtain to desire 
conclusion. 

Remark 3.1.2:The main theorem may be applied to get monotone iterative techniques for nonlinear problems 
in term of two monotone functions. That is the generilazation of [1]. 
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Abstract 

Dynamical behaviors of a new chaotic attractor is investigated in this paper. Basic dynamical 
properties of the new attractor system are analyzed by means of equilibrium points, eigenvalue 
structures, Lyapunov exponents and parameters regions. Chaotic electronic implementation of 
the new attractor were designed and simulated in OrCad-PSpice®. Finally, the chaos generators 
are experimentally confirmed via a novel circuit design. 

Indexing Terms: Chaotic attractors, Chaotic systems, Chaotic circuits, Chaotic oscillators, 
Lyapunov Exponents 

1. Introduction 

The first classical chaotic system is found by Lorenz when he studied the atmospheric 
convection in 1963[1]. Rossler carried out an important work, which rekindled the interest in low 
dimensional dissipative dynamical systems[2] in 1976. Rossler himself proposed an even simpler 
(algebraic) system[3] in 1979. Sprott embarked upon an extensive search[4] for autonomous 
three dimensional chaotic systems. Chen constructed another chaotic system[5], which 
nevertheless is not topologically equivalent to the Lorenz's[5, 6]. This system is the dual to the 
Lorenz system and similarly has a simple structure[6]. Lu and Chen found the critical new 
chaotic system [7], which represents the transition between the Lorenz and Chen attractors. It has 
been noticed that purposefully creating chaos can be a nontrivial task with interesting impact on 
both basic research and engineering applications. There has been increasing interest in exploiting 
chaotic dynamics in engineering applications, where some attention has been focused on 
effectively creating chaos via simple physical systems such as electronic circuits[8]-[ll]. Lately, 
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the pursuit of designing circuits to produce chaotic attractors became a focal subject for 
electronic engineers, due not only to the theoretical interest but more importantly to their 
potential real- world applications [12] in various chaos-based technologies and information 
systems [12-18]. 

Motivated by these works, this paper introduces one more simple, interesting three-dimensional 
quadratic autonomous system which can depict complex 2-scroll chaotic attractors 
simultaneously. Section 2 introduces and analysis the new chaotic system. Analysis and 
simulation results of the new system (Fig. 1., 2.) are also obtained in section 2. Section 3 
presents the designed electronic circuit schematic(Fig. 3.), the OrCad-PSpice® simulation 
results(Fig. 4.) and the real circuit implementation oscilloscope outputs(Fig. 5.) of the new 
attractor. Finally, conclusions and discussions are given. 

2. Dynamical Analyses of A New Chaotic Attractor 

Following nonlinear autonomous ordinary differential equations are the new chaotic system: 

x = - a-y -z 

y = - a-x - y + y-z (1) 

z= b + c-x-d-y 2 

Typical parameters are a=3, b=12, c=2, and d=6. The new system equations has two equilibrum 

. » .. . c±Vc 2 +4-a 2 -b-d c + Vc 2 + 4-a 2 -b-d „ . 

points as ( x , y , z ) = ( — — , , ) . 

2-a -d 2-a-d 

As the variables x, y, z e SR, this implies that fixed point to exist, vc 2 + 4-d-a 2 -b > 0. The 
equilibrium points of the new systems are (x*,y*,z*) = ( 0.4903, -1.4709, ) and 
(x*,y*, z*) = (-0.4532, 1.3597,0) for a=3, for b=12, c=2, and d=6 values. For the fixed 



point_l, (x*,y*, z*) = ( — — ; , , 0), by solving the 



c + V c 2 +4-a 2 -b-d c + Vc 2 +4-a 2 -b-d 
2-a 2 -d ' 2-a-d 

characteristic equation, the eigenvalues are found as follows; 

X , =-5.4422, A 2 = 2.221 1-6.03 14 -i, ^ =2.2211 + 6.03 14- i for a=3, b=12, c=2, and d=6. 

Vc 2 +4-a 2 -b-d c - Vc 2 +4-a 2 -b-d 
2-a 2 -d 

solving the characteristic equation, the eigenvalues are found as follows; 



* * * V 



For the fixed point_2, ( x , y , z ) = ( — — , , ) , by 

2-a -d 2-a-d 
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X , =-4.5050, A 2 =1.7525 - 6.5623 -i, 4, =1.7525 +6.5623 -i for a=3, b=12, c=2, and d=6. 

Note that the real parts of these eigenvalues are positive. Consequently the equilibrium points are 
unstable and this implies chaos. So, the system orbits around the two unstable equilibrium points. 
Interestingly, the origin(0,0,0) point is not equilibria for the new system. The equilibria and 
eigenvalues for certain chaotic systems are tabulated in Table I. 



Table I. Equilibria and eigenvalues for certain chaotic systems 



System 



Parameters 



Equilibria 



Eigenvalues 



Lorenz system 



Chen system 



Lu system 



The new system(l) 



a=10,b=8/3,c=28 



a=35, b=3, c=28 



a=36, b=3, c=20 



a=3, b=12, c=2, d=6 



I (0,0,0) 

[(±6>/2, ± 6V2", 27) 

\ (0,0,0) 

[(+3V7, ±3V7, 21) 

[ (0,0,0) 
[(±2Vl5,±2Vl5,20) 



-22.8277,-2.6667, 11.8277 
-13.8546, 0.0940 ±0.1945 -i 

-30.8359, -3, 23.8359 
-18.4288, 4.2140 ± 14.8846 • i 

-36, -3, 20 

-22.6516, 1.8258 ±13.6887 i 



1(0.4903, -1.4709,0) -5.4422, 2.221 1 ± 6.0314 • i 
[(-0.4532, 1.3597,0) -4.5050, 1.7525 ± 6.5623 -i 



Figure 1. shows the Lyapunov Spectrum of the new system for varying parameter a, and constant 
parameters b=12, c=2, and d=6. As can be seen from the Lyapunov exponents spectrum, the new 
system is chaotic when a positive Lyapunov exponent. 



Lyapunov Spectrum of The New system 




4 6 

Parameter, a 



10 



Figure 1. Lyapunov Spectrum of the new system for varying parameter b, and constant 
parameters b=12, c=2, and d=6. 
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The Figure 2. shows the Matlab® simulation results of the new attractor. 




x x y 

Figure 2. Phase portraits of the new attractor ( a=3, b=12, c=2, d=6 ) 

3. Electronic Circuit Design and Implementation of The New Attractor 

Figure 3. shows the designed circuit schematic for the new chaotic system(l). The circuit 
employs simple electronic elements such as resistors, and operational amplifiers, and is easy to 
construct. Despite the fact that origin(0,0,0) point is equilibria for the Lorenz, Chen, and Lu 
systems, it's not equilibria for the new system. Because of the fact that origin(0,0,0) point is not 
equilibria for the new system, it's not require the initial condition voltages for executing the 
circuit. Consequently realization of the new circuit is very easy. 

We use UA741 opamps, the Analog Devices AD633JN multipliers, appropriate valued resistors 
and capacitors for pspice simulations and real circuit implementation. The circuit is supplied 
±15V power supplies. Acceptable inputs to the AD633 multiplier IC are -10 to +10 V. The 
resistors Rl - RIO, are all shown with nominal values in Figure 3. 

The OrCad-PSpice® simulation results of the new attractor (x-y, x-z, y-z attractors respectively ) 
is shown in Figure 4. The real circuit implementation oscilloscope outputs(x-y, x-z, y-z attractors 
respectively) of the new chaotic system also shown in Figure 5. The parameters are taken as a=3, 
b=12, c=2, d=6 and the all initial conditions as zero on both the OrCad-PSpice® simulation and 
the real circuit implementation. 

As can be seen the related figures, the Matlab® and the OrCad-PSpice® simulation 
results(Fig.2,4) and also the real circuit implementation oscilloscope outputs(Fig. 5) give the 
same conclusions. 
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Figure 3. Designed Electronic Circuit Schematic of the New Chaotic Attractor 
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Figure 4. The Pspice simulation results of the New Chaotic Electronic Circuit, (a) x-y phase 
portrait, (b) x-z phase portrait, (c) y-z phase portrait 
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(a) 



(b) 




(c) 
Figure 5. Oscilloscope outputs of the real circuit implementation of the new attractor (xy, xz, yz 
attractors respectively) 

4. Conclusions 

The aim of this article is to present and further study a simple, interesting, and yet complex 
three-dimensional quadratic autonomous chaotic system which can generate complex 2-scroll 
chaotic attractors simultaneously. Our investigation was completed using a combination of 
theoretical analysis, simulations and real experimental implementation. Electronic circuitry of 
the new chaotic system is very simple. The simulation results were produced using Orcad- 
PSpice® program. As can be seen the related figures(Fig. 2,4), the Matlab® and the OrCad- 
PSpice® simulation results and also the real circuit implementation oscilloscope outputs(Fig. 5) 
give the same conclusions. To implement as electronics of this new chaotic system is very easy 
due to having zero initial conditions. 
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In practical applications it is crucial that the drive-response systems, although 
identical in all respects, are synchronized at all times even if there is noise 
present. In this work we are testing the stability and robustness of three distinct 
and well-known cryptographic chaotic systems and compare the results in 
relation to the desired security. 

Keywords: Chaos, chaotic signal, nonlinear circuits, synchronization, communication 
system security 

1 Introduction 

The use of synchronized chaotic systems for communications usually relies on 
the robustness of the synchronization within the transmitter and receiver pair [1- 
7]. However, if the communication channel is noisy and/or there is internal noise 
at the electronic circuitry, the distorted signal at the receiver input might cause 
considerable synchronization mismatch between the transmitter-receiver pair [8- 
12]. 

In this paper, we consider three dynamical systems; the first one is presented in 
[13], the second one is a Chua-like dynamical system [14] and the third one is a 
Lorenz-like system presented in [15] and we compare the effect of noise on the 
synchronization of the systems with different noise levels. 
The paper is organized as follows: the circuits' descriptions and the 
synchronization properties are presented in Section 2. The simulation results 
obtained are shown in Section 3. Finally, concluding remarks are given in 
Section 4. 
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2 Description of Circuits 

We present three non-linear cryptographic chaotic circuits and investigate their 
synchronization's stability and robustness to external noise. 

2.1 Non-autonomous, non-linear electronic circuit 

The first circuit [13] is a combination of two stages (both for the transmitter and 
the receiver). The first stage is a linear periodic oscillator consisting of an 
inverting amplifier and two integrators. The second stage that acts as nonlinear 
feedback consists of a comparator, a sub-stage that adjusts voltage levels from 
iVsat Volts to and 5 Volts respectively, a XOR gate and a buffer with a voltage 
divider as input. This stage is used to externally trigger the oscillator. The entire 
circuit produces chaotic oscillations under certain triggering conditions. All 
amplifiers, integrators, the comparator and the buffer were implemented with 
operational amplifiers. 

The chaotic voltage across the last of the two integrators is selected and 
compared with a certain dc voltage level. The result of the comparison is a 
voltage signal switching between iV^ voltage levels, where ±V sat are the 
positive and negative saturation levels of the operational amplifier. This signal, 
after being normalized to and 5 Volts, is multiplexed at the transmitter's XOR 
gate with the message and transmitted to the receiver. The transmitted signal is 
used at the receiver to drive the receiver's XOR gate, which decrypts the original 
message, Fig.l. The transmitter-receiver system is governed by the following set 
of equations: 



(1) 



(2) 

' R s * 

RC ^L = -V-*-V, (3) 

dt 

Where v = -—V -V >V,, =U" -F , F = M@H S and U* = k-S V, 

V 
where k is the ratio of potentiometer R 2 . When we are adding the filter after V out2 

V , 1 V (4) 

v c i ; — : — r y out 2 




Jl + a 2 R e 2 C e 2 

f OF, F C <2.5F _ f 0, V c < 2.5 V 

l 5V, F C >2.5F <=> M ~\ V C >25V 
The values of the parameters used in circuit A are given in Table 1. 



v - r" '*—" ^v ={ ' Vc - 25V (5) 
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Fig.l Schematic diagram of the transmitter-receiver system (circuitA). 



249 



ANAGNOSTOPOULOS ET AL: TESTING STABILITY AND ROBUSTNESS 



R 


10 kfi 


R s 


510kQ 


R f 


181dl 


Ri 


10 kQ (potentiometer at 50%) 


R 2 


10 kQ. (potentiometer at 100%) 


R D 


IkO 


DC voltage 


2V 


C 


lnF 


diode 


1N4001 


zener 


1N4733A 


AND gate 


74ALS08M 


XOR gate 


74ALS86M 


op amp's 


TL084CD 



Table 1 Parameters values and types of the elements used in the circuit A 

2.2 Chua-like non-linear electronic circuit 

The second circuit is a combination of two stages (both for the transmitter and 
the receiver). The first stage is a Chua-like chaotic oscillator [14] where the 
nonlinear resistor (Chua's diode) is implemented with two negative resistors 
connected in parallel, using two operational amplifiers and six resistors. The 
circuit has the same functionality with the original Chua's circuit and with 
appropriate values of the variable resistor produces chaotic oscillations. 
The second stage consists of a comparator, a sub-stage that adjusts voltage levels 
from iVsat Volts to and 5 Volts respectively, a XOR gate and a buffer with a 
voltage divider as input. Both the comparator and the buffer were implemented 
with operational amplifiers. The receiver is identical to the transmitter except 
that a low-pass filter is added at the buffer's output, followed by an AND gate. 
The chaotic voltage across one of the two capacitors is selected and compared 
with a certain dc voltage level. The result of the comparison is a voltage signal 
switching between ±V sat voltage levels, where ±Y sxt are the positive and negative 
saturation levels of the operational amplifier. This signal, after being normalized 
to and 5 Volts, is multiplexed at the transmitter's XOR gate with the message 
and transmitted to the receiver. The transmitted signal is used at the receiver to 
drive the receiver's XOR gate, which decrypts the original message. There is no 
feedback, so we use the voltage across the other capacitor as the synchronization 
signal between transmitter and receiver, Fig.2. The transmitter-receiver system is 
governed by the following set of equations: 



dV C] 



c 1 -^ = G(v C2 -v C] )- g (y cl ) 

at 
dV r 



C, 



dt 



-G(y C) -v C2 ) + i L 



dt 



(6) 

(7) 
(8) 
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Where g( v c ,) = m V C] + l -{m, -m ) (\V Ci +B p \-\v ci -B p \ ), G 



m =m u + m 02 



R B R gl 



B„ 



R 



gi 



R B +R g2 



< i i ^ 

— -i — 

V R gi R *i) 



and 



V ot<l =U -F 



Where F = M ®H S , H s _ | ~^«»n«/o»» v c\ >V o „s _ / 

v_i_ T7 17 ^ 7/ V 



+ F V <V 

saturation ' f C I o 



and [/* - a: • 5 V , where k is the ratio of potentiometer R 2 . 



*c>, 



^,, 



(9) 
>1 

<1 



While when we are adding the filter after V out 2 
1 



K c = 



^A// 



-F„ 



OF, V r < 2.5 F 



Vl + « 2 i?/C c 

{ 



o^ 



^ 



0, r r <2.5F 



F c > 2.5 F 



^5 F, V c > 2.5 F 
The values of the parameters used in circuit B are given in Table 2. 



(10) 
(11) 



Ra 


220 n 


Rb 


22 kQ 


Re 


2 Ml (potentiometer at 50% [chaotic region ranging 
from -20% to -90%]) 


R s i 


2.2 Ml 


R e2 


3.3 HI 


Rd 


1 kO 


R, 


10 kQ (potentiometer at 50%) 


R 2 


10 kfl (potentiometer at 100%) 


c, 


lOnF 


c 2 


100 nF 


L 


18 mH 


DC voltage 


2V 


diode 


1N4001 


zener 


1N4733A 


AND gate 


74ALS08M 


XOR gate 


74ALS86M 


op amp's 


TL084CD 
(E rat « 7.5V for 9V feed) 



Table 2 Parameters values and types of the elements used in the circuit B 
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Fig.2 Schematic diagram of the Chua-like transmitter-receiver system (circuit B). 
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2.3 Lorenz-Hke non-linear electronic circuit 

The third circuit is a combination of two stages (both for the transmitter and the 
receiver). The first stage is a Lorenz-like chaotic oscillator [15]. It consists of 
three integrators, four summing amplifiers (having two inputs each), three 
inverting amplifiers (having one input each), a non-inverting amplifier (with one 
input) and two multipliers. 

The second stage consists of a comparator, a sub-stage that adjusts voltage levels 
from ±V sat Volts to and 5 Volts respectively, a XOR gate and a buffer with a 
voltage divider as input. All amplifiers, integrators, the comparator and the 
buffer were implemented with operational amplifiers. The receiver is identical to 
the transmitter except that a low-pass filter is added at the buffer's output, 
followed by an AND gate. 

The chaotic voltage across one of the three capacitors is selected and compared 
with a certain dc voltage level. The result of the comparison is a voltage signal 
switching between ±V sat voltage levels, where ±V sat are the positive and negative 
saturation levels of the operational amplifier. This signal, after being normalized 
to and 5 Volts, is multiplexed at the transmitter's XOR gate with the message 
and transmitted to the receiver. The transmitted signal is used at the receiver to 
drive the receiver's XOR gate, which decrypts the original message. Again, there 
is no feedback, so we use the voltage across one of the other two capacitors as 
the synchronization signal between transmitter and receiver, Fig.3. The 
transmitter-receiver system is governed by the following set of equations: 



dV x 
dt 

dV 3 
dt 

dV 2 
dt 



K, 



R„CR 



'V, 



1 



R~, 



RCR 



■V,- 



R X CR 

1 



■K 



R„ 



R r CR> 



V 2 + 



1 



1 + - 



R-,, 



R. 



V,K 



RC 



1 + ^L 



vy, 



(12) 



(13) 



(14) 



V n ,„=U-F 



(15) 



where F = M@H S , R s = j 



-V. 



v >v c c 

saturation ' 3 ^^ Tjo _ < _ 



+ V V, < V 

1 r saturation ' * 3 r o 



and Jj" = k ■ 5 V , where k is the ratio of potentiometer R 2 



While when we are adding the filter after V out 2 
1 



F r = 



V - 



(OV, 



:V„, 



V C <2.SV T/ 



ro, 



V c < 2.5 V 



V c > 2.5 V 



(16) 
(17) 



5V, V C >2.SV "" v l, 
The values of the parameters used in circuit C are given in Table 3. 
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Fig.3 Schematic diagram of the Lorenz-like transmitter-receiver system (circuit C). 
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R 


10kQ 


R50 


50 kQ 


Rx 


ikn 


R200 


200 kQ 


Rv 


2k£l 


R30 


30 Ul 


R 3 


3tel 


R« 


6kQ 


RlOOM 


100 MO 


R, 


10 kQ. (potentiometer at 50%) 


R 2 


10 kQ (potentiometer at 100%) 


Rd 


1 kQ 


C 


100 nF 


DC1 voltage 


2V 


DC2 voltage 


-20 mV 


diode 


1N4001 


zener 


1N4733A 


AND gate 


74ALS08M 


XOR gate 


74ALS86M 


op amp's 


TL084CD 



Table 3 Parameters values and types of the elements used in the circuit C 



3. Simulation results 

We have selected Multisim to simulate the three chaotic systems, since it 
provides an interface similar to the real implementation environment. External 
noise is applied on the communication channel, while different noise amplitudes 
A have been utilized ranging from 0.01% to 50% of the mean signal amplitude. 
As the noise amplitude A is increased, the synchronization of the system 
continuously deteriorates and is practically destroyed in all cases above a certain 
noise level. 

A thermal noise generator connected at the communication channel provided 
artificial external noise added at the simulation. The information added is a 
square pulse with a frequency of 6.222 KHz ranging from to 5 V connected at 
the XOR gate of each circuit's transmitter. Both the transmitter and the receiver 
are identical circuits. The filters used in the simulations are presented in Table 4. 



Re 



Filter 1 R,=40 Q 
Filter 2 R^=l kQ 
Filter 3 R^l kQ 



Filter 1 C e =7 nF 
Filter 2 C e =2.5 nF 
Filter 3 C e =7 nF 



Table 4 Filter parameters 
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3.1 Circuit A 

Fig. 4 and 5 show the response of circuit A, without noise and with the 
application of 10% noise on the communication channel, which also acts as the 
synchronization channel. Different noise amplitudes A have been utilized and the 
synchronization of the system deteriorates severely above 10% noise level. 
It is apparent that the signal at the receiver without filtering shows some glitches 
due to the response of the circuit's elements, which disappear when a filter is 
added at the receiver's output. In Fig. 5, filter 2 eliminates the glitches 
completely compared to filter 1 although both filters introduced a slight time 
shift in the response signal. 

However, the synchronization is good (up to 10% noise level) and the 
transmitted information is received and reconstructed (decoded) at the output 
with good quality. 




o 0,0010 



0,0015 



0,0020 0,0025 

time 



0,0030 



Fig.4 Response of circuit A without noise Fig.5 Response of circuit A with 10% noise 
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3.2 Circuit B (Chua-like) 

In circuit B we used two communication channels, one for the synchronization 
and one for the information transmittance. All simulations of circuit B at the 
receiver are performed with the usage of filter 1 . 

Similarly with the previous circuit, we experimented with different noise levels 
and the synchronization is very good up to 10% noise level, Fig. 6 and 7. The 
noise was added either to synchronization channel only or to information channel 
only or to both channels. However, one could observe that in the third case, at 
the receiver with noise in both channels, the response signal demonstrates a 
transient behavior before perfect synchronization is achieved, Fig. 7. 
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Fig.6 Response of circuit B without noise Fig.7 Response of circuit B with 10% noise 
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3.3 Circuit C (Lorenz-like) 

In circuit C, as in B, we used two communication channels, one for the 
synchronization and one for the information transmittance, while filter 3 is used 
at the receiver. 

Additionally, in this system we can distinguish two separate cases (Ca and Cb); 
the first one where we use Vj as the synchronization voltage and V 3 is the 
voltage that goes to the comparator (Fig. 8 and 9). The schematic diagram in Fig. 
3 is corresponding to this case. In the second case we are using V 3 as the 
synchronization voltage and V! as the voltage that goes to the comparator (Fig. 



10 and 11). 




Fig.8 Response of circuit Ca without noise Fig.9 Response of circuit Ca with 1 % noise 



Fig. 8 and 9 show the response of circuit Ca without noise and with the 
application of 1% noise on the communication (synchronization and 
information) channels. Different noise amplitudes A have been utilized and the 
synchronization of the system deteriorates severely above 1% noise level. 
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However, it is apparent that the signal at the receiver with noise in both the 
information and the synchronization channel is decoded with no impairment at 
the present level of noise. The synchronization of the transmitter -receiver 
system is very good up to 1% noise level. 
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Fig. 10 Response of circuit Cb without noise Fig.l 1 Response of circuit Cb with 1% noise 



Fig. 10 and 11 depict the response of circuit Cb without and with noise. In this 
case we observed anti-synchronization (AS) phenomenon in the coupled Lorenz- 
like chaotic oscillators depending on the initial conditions [16]. AS has potential 
application in practical fields such as secure communications and digital 
communication. As in circuit Ca the system is robust up to 1% noise level and 
the received signal although anti-synchronized is decoded with no impairments. 
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4. Concluding remarks 

The use of synchronized chaotic systems for communications relies on the 
robustness of the synchronization to perturbations in the drive signal. 
In this work we have studied the influence of noise on the synchronization of the 
transmitter-receiver pair presented in [13, 14, 15] by simulating the behavior of 
the systems in Multisim. The results have shown the robustness of the systems 
on the synchronization for similar levels of noise amplitudes. Specifically, 
circuits A and B are withstanding higher amplitude noise perturbations 
comparing to circuit C. Among circuits A and B, the latter one uses a filter with 
a lower cut-off frequency in order to eliminate the glitches appearing at the 
receiver and, even though it shows some transient behavior, the output is of 
better quality than A. Although circuit C uses the filter with the lowest cut-off 
frequency, it decodes the signal without flaws even in the anti-synchronization 
case. 

Concluding our experimental study, we could state that there is no doubt that 
robustness to noise is very advantageous for the synchronization of a system, 
especially when the system is realized with off-the-shelf electronics. 
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In this paper the in-out intermittent synchronization of two coupled, nonlinear, 
double-scroll, chaotic operating, circuits is experimentally studied. The 
synchronized circuits are bidirectionally coupled via a linear resistor. In order to 
determine the kind of intermittency demonstrated laminar lengths versus the 
deviation of the control parameter from its critical value, and the mean laminar 
length distribution, are studied 1 . 

1 Introduction 

Research activities in chaotic circuits and systems, resulted in a lot of 
publications on the related phenomena that such systems exhibit [1], [2]. Since 
the introduction of the notion of chaotic synchronization by Pecora and Carroll 
[3], the topic of coupled chaotic circuit synchronization has been studied 
intensely, with numerous interesting applications, such as broadband 
communications systems [4]-[7] and cryptography [9]-[13], coming out of this 
research. 

An important issue on the synchronization of chaotic systems is the way that it is 
established. In most cases, when the coupling factor falls short of a critical value, 
the synchronized state becomes unstable and characteristic intermittent dynamics 
are observed. The difference between two signals from each subsystem blows 
occasionally from its almost zero value, demonstrating instant 
desynchronization. This kind of transition is termed "On-Off Intermittency" and 
its dynamics are quite different from those of the three classic intermittency 
types (scenarios) observed in chaotic systems [14]-[16]. Such intermittent 
behaviour is observed both in unidirectional and bidirectional coupling. 



This work was partly presented in the "3rd International Interdisciplinary Symposium on Chaos and 
Complex Systems - CCS2010" 



262 



KYPRIANIDIS ET AL: EXPERIMENTAL IN AND OUT SYNCHRONIZATION 



There have been also reports of another type of intermittent behavior known as 
"In-Out intermittency" [17], [18]. This kind of intermittency is a more general 
version of "On-off intermittency" [19] ..appearing most frequently in chaotic 
synchronization of bidirectional coupled circuits and systems [20], [21]. In the 
case of "In-Out intermittency", trajectories also escape occasionally from the 
relatively steady synchronized state to irregular "burst" states and then quickly 
return back to the synchronization. As a result, the system attractor blows out 
from a lower dimensional subspace in a random-like way, due to transverse 
instability [18]. 

The route from synchronization to desynchronization has been experimentally 
studied for two coupled, double-scroll circuits for the case of a certain parameter 
set both bidirectionally [22] and unidirectionally coupled [23]. At those papers it 
was shown that the statistics obeyed the laws describing On-Off Intermittency. 
In the present paper, the same resistiveley coupled double scroll circuits are 
experimentally studied employing another set of parameters. With this 
configuration the system undergoes the transition from synchronization to 
desynchronization of the In-Out Intermittency type. 



2 The coupled double-scroll circuit 

The system that is formed by the bidirectional resistive coupling of two identical 
nonlinear double-scroll circuits, appears in Fig. 1 . Both circuits are trimmed to 




Figure 1: The y C 2-bidirectionally coupled (y-coupled) double-scroll circuits. 

operate in a chaotic mode. The normalized set of state equations that govern the 
two subcircuit system dynamics is: 
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-C-/(x,) 



(1) 



y, =z,+^-(y 2 -y 1 ) 
z, = -ax, -a-y, -b-z, 

x 2 = y 2 

y 2 = z 2+^-(y, -y 2 ) 

z 2 = -ax 2 -a-y 2 -b-z 2 +c-/(x 2 ) 

The first three equations of system (1) describe the first of the two coupled 
identical double-scroll circuits, while the other three describe the second one. 
Signals xi >2 , yi,2, and z 12 , represent the voltages at the outputs of the operational 
amplifiers (LF411) 1, 2 and 3 respectively, as it is shown in Fig. 1. Saturation 
function f(x 12 ), used in Eq. (1) is defined by the expression of Eq. (2): 
' 1, ifx>k 



/(*) = 



1 



■1, 



if-k<x<k 
if x < -k 



(2) 



This implementation f(xi 2 ) is implemented in such a way that the saturation 
plateaus are at ±1 and the slope of the linear region is 1/k. Since the coupling of 
the two circuits is bidirectional, the coupling coefficient ^=R/2R C is present at 
the equations of both circuits. 

Resistance and capacitor values were: R=R4=R5=R6=R7=R8=R9=Rio=Rn=20k£2, 
and Ci=C2=C3=lnF. The saturated circuit was implemented with the operational 
amplifiers (LF411) numbered 4 and 5, where Ri 2 =25kQ, Ri 3 =Ri 5 =lkQ, and 
Ri4=14.3kQ. It should be mentioned that the operational amplifier 6 implements 
the function -f(x). Using R 16 =R 17 =lkQ, R^OkQ, R 2 =14.4kQ, R 3 =20.4kQ and 
R x =12,5k£2, we defined a, b, c and k as follows: 

cx = ^^, b=^^, c = ^ — , k = ^ (3) 

R,C 3 R S .C, R X C 3 R 3 

In contrast to Refs [22] and [23] where c=l, in the present report the normalized 
value of c was: c=0.8. Parameters a and b and k were set again to a=0.5, b=0.5, 
k=0.7, so each of sub- circuit, operates in a chaotic mode and exhibits a double 
scroll attractor as shown in Fig. 2. 



mm 



-4.00 y 
:±£2V_ 




-4.00 V 
-4.61V 



Figure 2: The double-scroll attractors of each circuit when they operate independently. 
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3 Experimental Results 

Resistance Re in the denominator of coupling coefficient § served as the 
system's control parameter and its value was changed from almost 9 kQ. down to 
almost 7 kQ. Although, in this region each circuit remained chaotic, the coupled 
system underwent a transition from full to incomplete synchronization. 
Signals x l5 x 2 and y b y 2 in both circuits were monitored by a four channel digital 
oscilloscope (Yokogawa DL9140), so that the time-series yi, y 2 , their difference 
(yi " Y2), the synchronization phase portrait (yi vs. y 2 ) and each separate circuit 
phase portrait (xi vs. yi and x 2 vs. y 2 ) could be simultaneously displayed and 
registered. 

A second digital oscilloscope (Tektronix TDS1002B), further connected to a 
laptop, was used to register the difference signal (y ; - y 2 ), in order to perform the 
statistics of the results. During measurements the oscilloscope was controlled by 
the laptop connected to it. For this reason a customized acquisition setup, based 
on NI's Lab View, was built [24]. 

As long as R c was below the critical value Rc- cr it= 8.7kQ, the two identical 
double-scroll circuits remained synchronized. For values of Rc lower than 8.5kf2 
the two circuits begun to demostrate incomplete (intermittent) synchronization. 








(a) (b) (c) 

Figure 3: Synchronization phase portraits (yi vs y 2 ) in the case of: (a) full synchronization 
(R c =8.8kfi), (b) intermittent synchronization (R c =7.9kfl) and (c) desynchronization (R c =7.1kfi). 

This behaviour was exhibited in the range 8.7kQ > R c > 7.1k£2, and with 

decreasing Rc the incomplete synchronization became stronger. The 

corresponding synchronization phase portraits (yi vs y 2 ) depict the transition 

from synchronization to desynchronization as follows: 

In Fig. 3(a) the synchronization phase portrait for R c =8.8kQ is shown. As 

expected in the case of synchronization, the trajectory remains along the 

diagonal. 

In Fig. 3(b) - for R c =7.9kQ - the corresponding phase portrait consists of both 

the diagonal and a wing-like structure below the diagonal. This behaviour of the 

trajectory is expected in the case of incomplete synchronization, with the 

diagonal corresponding to synchronized mode of operation and the escapes to the 

wing to desynchronization bursts. What is remarkable in these bursts is that they 

are spatially limited within the appearing wing-like structure. 

In the phase portrait in Fig. 3(c) (Rc=7.1kQ) the diagonal disappears and only 

the wing-like structure remains. Thus, desynchronization prevails and the 



265 



KYPRIANIDIS ET AL: EXPERIMENTAL IN AND OUT SYNCHRONIZATION 



trajectory, is always out of the diagonal. However the desynchronization is 
spatially limited and the trajectory remains strictly within the wing-like structure. 
In Figs. 4(a)-4(c) three representative cases of the intermittent synchonization for 
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Figure 4: Time-series of yi (upper side) and y 2 (lower side) and their difference (in the middle), in 
three typical cases of intermittent synchronization: (a) R c =8.2kn, (b) R c =8.0kfi and (c) R c =7.8kn. 
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decreasing values of the control parameter R c are presented. The time-series yi, 
y2 of each indivitual circuit (top and bottom timeseries), together with the 
difference signal (yi - y 2 ) (middle timeseries), are presented. The appearing 
bursts in the difference signal indicate escapes from the diagonal to the wing-like 
structure appearing in Fig 3(b). Obviously, these bursts become of longer 
duration and appear more frequently, with decreasing values of R c . 

4 Evaluation 



The evolution of the intermittent behavior as suggested by the curves of Figs. 
3(a)-3(c) and 4(a)-4(c), i.e. the route from synchronization to desynchronization 
between the two identical, coupled, double-scroll circuits, has the characteristics 
of intermittency [14], [15], [18]. In order to determine the kind of intermittency 
exhibited in the studied case, laminar length distributions and the scaling of the 
mean laminar lengths according to the difference of the control parameter from 
its critical value (Rc-Rc-crit), were measured and evaluated. 

In Fig. 5, a representative distribution P(i) of durations r of laminar lengths 
(synchronized state) of the difference signal, for R c =7.9 k£l is presented in a 



Figure 5: A typical semi logarithmic plot P(z) vs. i in the case of R c =7.9 kfJ. 

-logarithmic plot. The curve of this plot consists of a linear part with slope /? 
equal to -1.499. Similar distributions for other values of control parameter R c 
gave slopes P not substantially deviating from -1.50. Apparently, these 
distributions follow the theoretically predicted law [25]: 

P(t) oc t" (4) 

that holds for exponent /?=- 1.50. In the mentioned case of R c =7.9 kO, p deviates 
from this predicted value, only by 0.07%. Taking into account the estimated 
value of fi and the fact that the bursts correspond to jumps between two different 
manifolds (the diagonal and wing-like structure, respectively), the classification 
of this intermittency as one of the "In-Out" kind, can be safely supported [18]. 
Furthermore, mean duration <r> of laminar lengths versus the difference (Rc-Rc- 
crit), is presented in a double logarithmic plot, in Fig. 6. A linear fitting of the 
experimental data results to a straight line with a slope y equal to -1.051, clearly 
confirming that a power law of the following form holds: 

{t)k{R c -R c _J (5) 
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According to this law <x> scales with the difference (Rc-Rc-crit) with an exponent 
y=-1.0. Our value for y, deviates by 5.10% from the predicted one, further 
confirming the "In-Out" classification of the observed intermittency [18], [33]. 



M*c-*c-crit) 

Figure 6: Double logarithmic plot of <t> vs. (Rc-Rc-cm)- The line stands for the fitting of Eq 5. 

5 Discussion 

In this report the transition from synchronization to desynchronization of two 
identical double-scroll circuits, bidirectionally coupled, was experimentally 
studied and classified as one of the in-out intermittency. 

According to the measured timeseries of Figs 4(a)-4(c) the bursts, appearing in 
the difference signal (yi - y 2 ), result from corresponding jumps in the time-series 
yi(t), y2(t). What is remarkable is that these jumps happened almost always in 
opposite directions. This is a consequence of the behaviour of the trajectories in 
the phase-portraits of each double scroll circuit. As long as the two sub-circuits 





Figure 7: The attractors of each double scroll circuit when the circuits are desynchronized. 

remain synchronized, their trajectories describe identical double scroll attractors. 
However, during the jumps each of the original double-scroll attractors limits 
itself to only one of its scrolls but in a complementary way as shown in Fig. 7. 
It should be interesting to further investigate the conditions which lead to this 
behaviour and if the inverse effect is also taking place. 
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Abstract 

In this work, time series analysis techniques are used to analyze sequential, equi- 
spaced mass measurements of a Si density artifact, collected from an electromechan- 
ical transducer. Specifically, techniques such as Power Spectral Density, Bretthorst 
periodogram, Allan variance and Modified Allan variance can provide much insight 
regarding the stochastic correlations that are induced on the outcome of an exper- 
iment by the measurement system and establish criteria for the limited use of the 
classical variance in metrology. These techniques are used in conjunction with power 
law models of stochastic noise in order to characterize time or frequency regimes by 
pointing out the different types of frequency modulated (FM) or phase modulated 
(PM) noise. In the case of phase noise, only Modified Allan variance can tell between 
white PM and flicker PM noise. Oscillations in the system can be detected accurately 
with the Bretthorst periodogram. Through the detection of colored noise, which is 
expected to appear in almost all electronic devices, a lower threshold of measure- 
ment uncertainty is obtained and the white noise model of statistical independence 
can no longer provide accurate results for the examined data set. 

Key words: phase noise, time-series analysis, Fourier analysis, Bretthorst 
method, Allan variance 



1 Introduction 

Finding correlations in time series of measurements and defining the type of stochastic 
noise apparent in the measured signal remain very crucial issues for modern metrology. 
According to Zhang, when measurements are autocorrelated, the use of classical variance 
for the estimation of type A uncertainty of a data set, leads to wrong results [1] . Moreover, 
power law models of the type 1/P [2] are necessary to describe the type of stochastic noise 
that characterizes the system, which produces the time series. 
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In most cases, due to colored noise generation, the Frequency Modulated White Noise 
model (White-FM) fails to describe the system. An additional problem is Phase Modu- 
lated Noise (PM), apparent in all electrical oscillators [3] and more complex devices, as 
thoroughly reviewed and analyzed by Rubiola [4]. PM Noise is attributed to the phase 
fluctuations (or frequency fluctuations) of a signal produced by a real, non-ideal oscillator. 
In this oscillator the frequency of oscillation is modulated by electronic noise, inevitably 
leading to random frequency fluctuations in time and thus affecting the performance of 
the system that uses the oscillator. A list of reasons for the PM Noise generation is given 
by Howe [5] but still its origin remains a controversy issue in the areas of metrology. 

Generally there have been utilized several methods from both time and frequency 
domain, in order to best analyze the response of metrological instruments, electrome- 
chanical transducers in our case study. In this paper we will focus on Allan and Modified 
Allan variance (time domain) as well as Schuster and Bretthorst periodograms (frequency 
domain) . 

Allan variance, initially introduced by Allan in time and frequency metrology [6], is 
an alternative approach for the variance calculation of autocorrelated measurements and 
has been thoroughly used by Witt in the area of electrical measurements [7] . Because of 
the fact that this method cannot tell the difference between White PM Noise and Flicker 
PM Noise, the Modified Allan variance has been used instead [8]. 

In the frequency domain, Fast Fourier Transform and Schuster periodograms remain 
the most widely used tools for evaluating the different types of noise in the signal' s Power 
Spectrum. Schuster periodograms can detect oscillations in the signal and interpret them 
as individual peaks. Due to the limitations and in certain occasions misleading results 
of the Discrete Fourier Transform, an alternative method is proposed, based on Bayesian 
analysis: the Bretthorst periodogram [9]. This method also identifies oscillations in a 
signal and can distinguish between two very close frequency peaks that FFT treats as 
one. 

The data on which the above methods will be tested, was obtained from characteri- 
zation experiments of a newly commissioned 1kg/ lOmg resolution mass comparator at 
the Hellenic Institute of Metrology density laboratory. The principle function of this 
comparator will be the measurement of mass in air of Si and ceramic density artifacts of 
mass ca. 1kg in the form of spheres through comparative weighing. It should be noted 
that these methods can be applied to any electromechanical transducer system equally 
well with similar results. 



2 General Considerations 

Let' s consider an input signal of the following simple sinusoidal form 

V in (t) = V c sin(2nf c t) (1) 

The output of a non-ideal oscillator will be of the form 

Vout{t) = (V c + s(t))sin(2%f c + 4>{t)) (2) 
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where the time variations in amplitude are included into e(t) and the frequency devia- 
tion from the fundamental one is described by cp(t), called the phase fluctuations of the 
output signal. Ignoring amplitude variations and changing to frequency regime, phase 
fluctuations with a spectral density S^ (f ) and frequency fluctuations with a spectral den- 
sity S y (f), are described with equations (3) and (4), with h^ representing the intensity 
coefficients of each power law noise contribution and a, f3 are the spectral exponents: 



+2 
Sy(f) = E h «f a ( 3 ) 





S*(f) = E W> P = a - 2 ( 4 ) 

/3=-4 

3 Computational Methods 

3.1 Fourier Spectral Analysis 

The Discrete Fourier Transform is one of the most powerful tools in signal analysis and 
thoroughly used in many physical systems. The periodogram was introduced by Schuster, 
as a method of detecting periodicities and estimating their frequencies and is essentially 
the squared magnitude of the discrete fourier transform of the data. In 1965, Cooley and 
Tukey introduced the Fast Fourier Transform, a method that led to more efficient com- 
puter calculations and is considered nowadays an optimal frequency and power spectral 
estimator. 

By plotting S(f) - f in a log-log diagram, the different noise levels in the power spectrum 
can be estimated from the adjustment of equation (3) to the log-log plot. The calculation 
of the spectral exponent a, leads to the identification of white noise (a=0) , flicker noise 
(a=-l), random walk noise (a=-2) or any intermediate case -2<a<2 of colored noise [7]. 

Unfortunately, the Discrete Fourier Transform will provide accurate frequency esti- 
mates only when the following conditions are met [9,10]: 1) the length of the data series 
N is sufficiently large, 2) the data series is stationary, 3) there is no evidence of low 
frequency existence, 4) the data contain one stationary frequency, 5) the noise is white. 
When one or more of the above conditions is violated (the last one in our work) an alterna- 
tive method is proposed, based on Bayesian Analysis, called the Bretthorst Periodogram. 

3.2 Bretthorst Periodogram 

Bayesian Probability Theory defines a probability of occurrence as a reasonable degree 
of belief, given some prior information of the data. In our example the probability dis- 
tribution of a frequency of oscillation w is computed conditional on the data D and the 
prior information I, abbreviated as the posterior probability P(w|D,I). To calculate this 
one must find the direct probability (or likelihood function) P(D|w,I), the prior prob- 
ability P(o|I), the probability P(D|I) (in parameter estimation problems it is a simple 
normalization constant) and eliminate the nuisance parameters. 
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P(D\w,I).P(w\I) 

PHA/) = p[d\T) () 

Based simply on Bayes product and sum rules [11] one can obtain the posterior prob- 
ability of the frequency with or without prior knowledge of the noise variance a 2 in the 
signal, concluding to equations (6a) and (6b) correspondingly. Specifically (6b) is the 
well-known t-student distribution. An analytical proof of these relations can be found in 
[9, 10]. C(w) is the Schuster periodogram and d? is the observed mean-square data value. 

P(u\D,a,I)cxexp{C(u)/a 2 ) (a) P(u>\D,T) <x[l- *$&] (b) (6) 

Basically, the above equations give evidence that a single stationary frequency is 
present in the data and because of the processing in equations (6a-6b), all details of 
the periodogram are suppressed except the frequency peak, observed as a single spike in 
the Bretthorst periodogram. 

3.3 Allan Variance 

The Allan variance or Two-sample variance was first introduced by David W. Allan for 
the evaluation of the stability of time and frequency standards [6]. As well established, 
the most common measure of dispersion is the classical variance, whose value decreases 
as the number of data points included in the calculations, increases. Unfortunately this is 
only true in the case of truly random processes, where the variance of the mean decreases 
with the number N of data points as var(X)=2^ . 

Allan stated that in the case of autocorrelated data the above equation does not apply 
since there exists a possibility that the estimated variance will diverge as the number of 
data points increases [12]. So, we create a high-pass filter by extracting each k+1 value 
from its previous one k and thus we remove any possible trends, fast fluctuations or other 
peculiar characteristics. The Allan variance a y 2 (x) is estimated at time intervals T=mTo, 
where To is a minimum sampling time and m is usually chosen to denote powers of two. 

From the resulting plot of a y 2 (x)-x one can estimate the cut-off value after which the 
inclusion of more data points does not lead to the decrease of the variance. In a log-log 
plot the Allan variance is proportional to x M and \i = -tx-1, where a is the spectral exponent 
appearing in equation (3). Special cases [6,7] are: u=l (random walk noise), u=0 (flicker 
noise) and \l=-1 (white noise). 

3.4 Modified Allan Variance 

This variance was first introduced in the domain of optics because it divides white phase 
noise from flicker phase noise by the different dependence on gate time. More specifically, 
ModVar is proportional to x~ 3 for the former and x~ 2 for the latter and ModStd is 
proportional to x~ 3 ' 2 and x _1 correspondingly [13]. Given an infinite sequence {x^} of 
samples evenly spaced in time with sampling period xq, the ModVar is defined as 



273 



Georgakaki D. et al 



Modal(T) = 



N-3n+l n+j-1 



2n 4 r n 2 (iV-3n+l) ^ L ^ 

u v ' 7 — 1 2—7 



(Xi +2n (T) - 2.t 1+ „(t) + x % {t))] 2 (8) 



where n=l,2...N/3. The MVar obeys to a power law of the observation time x of the 
form Moda 2 ~ fcr M where ^ = — 3 — a [14]. 



4 Results 



After removing the deterministic component (linear trend because of the ambient tem- 
perature) of the data with the application of a first difference filter, the resulting series is 
carefully examined for correlations and noise. The lag plot and autocorrelation function 
of the first-differenced time series are presented below, in fig. (1) and fig. (2) correspond- 
ingly. 



Sample Autocorrelation Function (ACF) 
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Figure 1. Lag Plot with negative Figure 2. Autocorrelation function with 

correlations. oscillatory behavior. 

The lag plot reveals negative correlations between successive data points with lag=l 
but is unable to tell between White and Flicker PM Noise. Moreover, the autocorrelation 
function changes between positive and negative values for the first 200 lags (strong cor- 
relations) and afterwards, the data become statistically independent falling well within 
the 95% confidence bands of ±H=, implying that the white noise model is now sufficient 
to describe the measurements. In order to determine safely whether or not to use Al- 
lan Variance, additional information is needed from the frequency domain analysis. The 
Schuster periodogram and the Power Spectrum of the data are shown in the following 
figures. 
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Figure 3. Periodogram with a single 
peak. 



Figure 4. Power Spectrum with three 
different noise regions. 



The periodogram reveals a strong oscillation at approximately 0.0183 Hz (or 54.64 
sec). The power spectrum in a log- log scale, seems to be divided in three regions: at lower 
frequencies the blue line indicates a power law model of the form 1/f (Flicker FM Noise), 
the red line indicates that the White FM Noise model is adequate to describe the data and 
finally at higher frequencies the green line indicates a power law model 1/f -1 or l/f~ 2 (PM 
Noise). Thus, there exist two cut-off frequencies at which evident changes in slope occur, 
revealing the different noise areas. The total power spectrum is given by the equation 
Sy(f) = hofo + h-if-i + hifi (or r^f^), where h^ are the intensity coefficients. In order to 
be sure for the oscillation that FFT revealed, we apply the Bretthorst methodology and 
according to theory we expect a single spike at the frequency of 0.0183 Hz. In order to 
keep the same quantities of measurement we will calculate P(f|D,I). As can be observed 
in fig. (5), the single spike (red line) confirms the existence of f osc = 0.0183 Hz and 
as predicted by theory all the other information of the periodogram (black diagram) is 
suppressed to a uniform plateau of zero slope. 
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Figure 5. Comparison of Schuster and Bretthorst periodogram 
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From all the above, it is obvious that the use of classical variance for the calculation 
of type A uncertainty is inadequate and Allan variance will be used instead. In addition, 
Modified Allan variance will give a straightforward answer for the phase noise charac- 
terization problem in our data set. Fig. (6) below, gives the dependence of the Allan 
deviation over time. Clearly, there exist three different regions, in accordance with the 
power spectrum of fig. (4): the phase noise region \l=-l (or ^=-2 for the Allan Variance) 
indicated by the blue line, the white FM noise area [i=-0.5 (or ^=-1 for the Allan variance) 
adjusted by the red line and finally the flicker FM floor (pi=0). For t=256, o(t) = 1.9*10- 6 
in contrast to classical std which estimates g=9.57*10~ 5 . Note that the last two points 
are not included in the calculation. Probable causes of the flicker floor are power sup- 
ply voltage fluctuations, changes in the components of the artifact and microwave power 
changes. Fig. (7) gives the dependence of the Modified Allan deviation over time. The 
slope of the blue fitted line is -3/2, which indicates that white PM Noise appears at small 
times and correspondingly high frequencies, as already observed in the power spectrum. 
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Figure 6. Allan variance. 



Figure 7. Modified Allan variance. 



5 Conclusions 



The main purpose of this work is to point out the importance of considering measurement 
results as time series and of using the time series analysis methods to test for correlations 
and underlying stochastic noise. Only in the absence of correlation the use of the expres- 
sion a/y/N is appropriate to characterize the random uncertainty. Otherwise, the Allan 
variance is an alternate, more appropriate tool to characterize the dispersion of a set of 
experimental results. 

In the case of phase noise, only Modified Allan variance provides accurate results and 
discriminates flicker from white PM noise. Bretthorst periodogram is a powerful tool 
of bayesian spectral analysis which detects oscillations in an output signal and identifies 
peaks at a very close distance. For the case study of mass measurements we consider 
here, all the above techniques give consistent results. 
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Abstract 
A random walking of particles on the closed sequence of cells is studied. At the current 
time the particle occupies some cell. The transition of particle occurs at the integer time 
with a given probability provided that the cell, following the cell occupied by the particle, 
is free. The steady probabilities of system states and the average individual velocity of 
particles have been found. 



1. Introduction. Formulation of the problem 

The closed sequence of n cells is studied. There are m particles, < m < n. At the current 
time the particle occupies some cell. No more than one particle occupies the cell. The 
cell i + 1 follows the cell i, i = 1,2, ,n — 1. The cell 1 follows the cell n. The transitions 
of particle occur at the integer time 1,2,3,... If at the integer time the cell following the 
cell, which is occupied by the particle, is free then the transition of the particle occurs 
with the probability p, < p < 1, independent of the behaviour of the other particles. 

The discrete time models, which describe the movement of particles on the discrete 
lattice, are investigated in [1-5]. 

In [1] the lattice on the straight line, in which a random walking describes the traffic 
flow, has been considered. Each position of the lattice contains not more than one particle. 
It is not permissible for the distance between two neighbouring particles to be less than 
the minimum permissible value. If the neighbouring right particle approaches to the left 
one and the distance between the particles becomes less than the minimum permissible 
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distance then the left particle has to move aside to the left to keep the necessary distance. 
If the distance between the particle and the neighbouring one is more than the minimum 
permissible distance then at discrete time the particle moves with given probabilities to 
the right or to the left. We suppose that the probability of moving to the right is more 
than the probability of moving to the left. The case of two particles and the general case 
have been considered. It has been proved for the system of two particles that the distance 
between particles has in the steady state the geometrical distribution with the parameter 
depending on the parameters of particles movement. This result can be considered as 
follows. If the velocity of the leader is less than the velocity of that moving behind then 
the movement is synchronized at the steady state with the movement of the leader and the 
distance between the leader and the particle moving behind is distributed geometrically. 
It has been proved for the common case that the number of particles of a batch has the 
geometrical distribution with the parameter depending on the probabilities of particles 
movement. Model considered in [1] describes approximately such phenomena as reaching 
of the maximum capacity, appropriate to the optimal density of the traffic flow, and the 
traffic jam occurence. 

In [2] the model of work [1] has been generalized for the velocity of the car depending on 
the velocity of the car going ahead. Different kinds of dependences of the traffic intensity 
on the density have been found for the different parameters. It is shown that abrupt 
decrease of the intensity can been modelled for the case of the traffic density exceeding 
the optimal value. 

The theory of Markov chains was used in [1] and [2] for investigation of the random 
walking [6]. 

In [3] it has been found by means of the dual mapping the accurate results on several 
models of traffic flows. The descriptions of limit configurations have been obtained for 
these models. These results are used in [3] for investigation of a fast particle, which moves 
in the direction of the particles flow or against the direction of the particles flow. 

In [4] it has been studied by means of a new variation approach the ergodic properties 
of a model of a multi-lane traffic flow, considered as a deterministic walking of particles 
on an infinite lattice. For a class of initial configurations of particles the description of 
their limit behaviour is obtained, as well as estimates of the transient period. Statistical 
quantities describing limit configurations are obtained also. 
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In [5] a closed chain of cells, on which particles move, has been considered. The 
model time is continuous. Every particle can move with a given intensity for one cell 
forward remaining on its lane. If the appropriate cell is busy and the two neighbouring 
cells on the other lane are free, then the particle moves for one cell forward and comes 
to the other lane. The approximate method has been worked out for the calculation of 
the traffic flow velocity. The method is based on use of a Markov chain. This chain 
describes the behaviour of four neighbouring cells. It is assumed for the Markov chain 
that probabilities of transitions can be calculated as each of the four cells, neighbouring 
for the four considered cells, were busy with the probability equal to the flow density and 
were not independent on the states of the other cells. 

Some physical formulation and investigation of traffic models by simulation method 
have been represented in [7], [8]. 

The system, considered in our work, is described by the Markov chain. The chain 
states are characterized by the disposition of the particles. The number of the chain states 
equals the number C™ of combinations of m elements from n ones, where n is the number 
of cells and m is the number of particles. Let N be the number of chain states. 

Lemma 1. The considered Markov chain is irreducible. 

Proof. It is one and only one system state of the system corresponds to each binary 
n-valued integer number containing m "ones" and n — m "zeros" in their records. Besides 
it is possible, shifting "ones" to the neighbouring position with zeros, to come for a finite 
number of transitions from every state to every other state. Really, we can collect all the 
"ones" so that they made up a cluster, beginning from the most right position, and then 
we can arrange the "ones" appropriately. 

Let the chain states be numbered arbitrarily. Let pi be stationary probability of the 
i-th state, i = 1,,N. Let pij be the probability of the transition from the state i to the 
state j, i,j = 1,,N. 

The steady states probabilities of the chain satisfies the system of equations 

N N 

Pi Yl Pij = H PlPji^ i = l,---,N, (1) 

3=1 3=1 

E» = 1 - ( 2 ) 

Let k{i) be the number of clusters for the z-th state of the chain. We call "cluster" 
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the batch of the neighboring cells busy with particles and isolated each from other by the 
free cells. If the i-th state is the current state of the chain then the number of particles, 
which are able to move, equals the number of clusters for this state, i.e. this number is 
equal to k(i), < k(i) < m. There are 2 k ( 1 ' states to which the chain can pass from state 
i. Let l(i,j) be the number of particles that move if the chain passes from the state i to 
the state j, 1 < k(i) < m + 1. Then 

p ij =p^J){i- p) Ki)-Ki,J)^ l(ij)=o. (3) 

The probability, that the chain does not leave the i-th state at the current time, is equal 
to the probability that all the k(i) particles do not move. This probability equals pa = 
(1 — p) k ( l >. By this reason and in accordance with (2) 

E pa = i-(i- p) m - 

There exist steady probabilities of the considered Markov chain and these probabilities 
are unique. It follows from the known theorem of the theory of Markov chains. In ac- 
cordance with this theorem, if it is possible to come from an arbitrary state to the other 
arbitrary state for a finite number of transitions (it is equivalent to that all the elements 
of some power of the transition matrix are positive i.e. the Markov chain corresponding to 
this matrix is irreducible) then system (1)— (2) has a solution and the solution is unique, 
[6]. 

2. States with a given number of clusters 

Let S(k, n, m) be the number of k clusters states for number of cells equal to n and number 
of particles equal to m. 

Lemma 2. The equality is true 

{ T.C k ~\ CvTi i , k < minfm, n-m); 
S(k,n,m)=\ k m_1 n " m_1 " V ' ; ' ( 4 ) 

I 0, k > min(m,n — m). 
Proof. Let R(k, m) be the number of ways to represent the number m as sum of k items 
provided the order of the items is taken into account 
{k < min(m, n — m)). It is the number of ways to take k — 1 elements from m — 1 ones: 

R{k,m) = C k m _\. (5) 
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Let us find the number A(k, n, m) of the elements of the set A of states with k clusters 
and for that cell 1 is free and cell 2 is busy. This number equals to the number of ways 
to distribute m particles on k clusters (this number equals R(k,m)) multiplied by the 
number of ways to choose the lengths of k — 1 gaps (this number equals R(k, n — m)). So 
we have for k < min(m, n — m) 

A(k,n,m) = R(k,m)R(k,n — m). (6) 

It follows from (5) and (6) that 

A(k,n,m) = Ct} 1 Cil 1 m _ 1 . (7) 

Let state a = (i±, . . . , i n ) be an element of set A. Let b(a, d) be the state that is at- 
tended from the state a by turning, provided the i-th cell i comes to the position, that 
was occupied by the {i + <i)-th cell, i.e. 

b(a, d) = (i n -d+i,in-d+2, ■ ■ ■ , in,h, ■ ■ ■ , in-d)- Every k clusters chain states can be repre- 
sented as b(a, d) for k different ordered pairs (a, d), where a is some element of set A and 
d is one of the number 0, 1, . . . , n — 1. There esixt nA(k, n, m) non-identical pairs (a, d). 
So 

Tl 

S(k,n,m) = —A(k,n,m). (8) 

k 

Equation (4) follows from (7) and (8). Lemma has been proved. 



3. Steady probabilities of states 

Theorem 1. The solution of the system (l)-(2) is 

C 



Pi= (i-p)fc(O-i ' i = 1 >---> N > ( 9 ) 



where 



C ~\ 2^ h. ' C m-l C n-m-l n _ n \k-l \ ' ( 10 ) 



'min(ra, n—m) 

, k ~rn-l~n-m-l ^ _ ^ 

Proof. Let us write system (1) as 



-i 



N N 

J2 PiPiJ = Yl PjPjii i=l,---,N- (11) 

3=1 3=1 

Let F{i) be the set of states to that it is possible to come from state i at ones. Let 
F(i, I) be the subset of set F{i) containing the states to that it is possible to come from 
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the state i by transitions of I particles. Let B{i) be the set of states from that it is possible 
to come to state i at ones. Let B{i, I) be the subset of B{i) containing the states from 
that it is possible to come to state i by transitions of / particles. 
We have 

(0, j?F(i), i,j = l,...,N, 

Pa = { „ (12) 

\p\l-p) k ^-\ j€F(i,l), i,j = l,...,N, l = l,...,k(i), 

(0, j?B(i), i,j = l,...,N, 

Pa = { ,, (13) 

' y(l-p) k ®- 1 , j€B(i,l), i,j = l,...,N, l = l,...,k{i). 

Taking into account (12) and (13) we can write (11) as 

k(i) k(i) 

J2caid(F(i,l))p iP l (l-p) k W- l = J2 E PjP l (l-p) k{j) - l ,i = h---,N. (14) 

1=1 l=ljeB(i,l) 

We use the designation card(A) for the number of the elements of set A. 

Substituting (9) to (14) we can write (14) as 

k(i) k(i) 

J2c&rd(F(i,l))p l (l - pf- 1 =^czxd{B{i,l))p l {l-p) l ~\ i = l,...,N. (15) 
l=i i=i 

Because of the symmetry caid(B(i, I)) = card(F(i, I)), 1 = 1,..., k(i), 
i = l,...,N. 

So solution (9) satisfies equation (11) and therefore it satisfies system (1). 

Equation (10) for C follows from (2), (9) and Lemma 2. 

Theorem 1 has been proved. 

4. The average velocity of particles 

Let us call the quantity of movement the number of particles moving at the current time. 
Let us call the average velocity of particle the ratio of the quantity of movement to the 
total number of particles. 

For the quantity of movement we have 

N 



Q = J2pM*)p- (16) 



i=l 

Theorem 2. 

For the average velocity of particles v the equation is true 

_. min(m,n— m) „ 

V -m Q ~m ^ (1 _ p) fe-i G ™-i^— i- 



295 



BUSLAEV, TATASHEV: PARTICLES FLOW... 



Proof. The statement of Theorem 2 follows from Theorem 1, Lemma 2 and equation 



(16). 



0.2 
0.18 
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0.14 -- 
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Figure 1: Dependence of the average velocity v on the flow density p, n = 10, 
p = 0.2. 



V 

0.4 
0.35 

0.3: 
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0.2 
0.15: 
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m/n 

0.2 0.4 O.b O.K 

Figure 2: Dependence of the average velocity v on the flow density p, n = 10, 
p = 0A. 

Lemma 3. 

(1) The average velocity of particle is an increasing function on parameter p. 

(2) v = p{l — r), where r is the probability that the cell following a busy cell is busy 
also. 

Proof. Statement (1) is a consequence of equation (16) and Theorem 1 in accordance 
with that the probabilities of the states, for that the number of clusters is larger, increases 
and the probabilities of the states, for that the number clusters is smaller, decreases. 

It is true for the quantity Q of movement 



Q = np{l — r). 



(17) 



From (17) and equation 



v= Q 

m 
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(111 
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Figure 3: Dependence of the average velocity v on the flow density p, n = 10, 
p = 0.8. 

statement (2) follows. Lemma 3 has been proved. 

The dependence of the average velocity of particles on the density of particles flow 
p = 2£ is represented in Fig. 1-3 for m = 10 and p = 0.2, 0,4, 0.8. 

5. Analysis of the case of the probability of transition close 
to 



We have from (9) that 



Pi = C + 0(p), p~0, i = l,...,N. 



We have from (2) and (18) 



Pi = Jj +°(p)j P~°> i = 1 , 



,N. 



(18) 



(19) 



Lemma 4- The equality is true for p ~ 

m — 1 



+ 0(1). 



n — 1 

Proof. Probability that a given cell is busy can be represented as jjC™Zi for p% = -h, 
i = 1, . . . ,N. Probability, that the cell following the given cell is busy also, is equal to 
jfC™S2 ■ The ratio of jjC™I 2 to jfC™~± equals r. Calculating this ratio we get the lemma 
statement. 

Theorem 3. 

1) It is true for i = 1, . . . , N 

Pi = — + 0(p), p~0. 
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2) The average velocity of particle equals 

v = p ■ + o(p), p ~ 0. 

n — 1 

Proof. The statement follows from equation (19), equation v = p{l — r) and Lemma 

4. 

6. Analysis of the case of the probability of transition close 
to 1 

Let K(n, m) be the maximum possible number of clusters for given m and n. Equation 
(9) can be written as 

Pi = A(l-p) K{ - n ^- k ^\ (20) 

where A is the probability of state with K(n, m) clusters. 
We have from (20) that 

Pi = o(l — p), k{i) < K(n, m), p ~ 1. 

Hence 

Q = K(n, m) + o(l —p), p ~ 1. 

Taking into account that 

K(n,m) = l 

[n — m, m > <£, 

we have 

{m + o(l — p), m < S, 
^ n ^ n (21) 

n — m + o(l — pj, m > 2 • 



Let us define /? as 



P== (22) 

n 

It follows from (21) and (22) that 

f l + o(l -p), p<\, 
v = I 1 1 (23) 

\l-l+ (l-p), p >I. 

Equation (23) corresponds to the results of the work [3], where it was considered a 
similar model for the case of the probability of the transition of particle close to 1. 
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7. Exact solution for the quadrangle 

Let us consider the case n = 4, m = 2. There are four one cluster chain states and two 
clusters chain states. 




Figure 4: One cluster chain state 





Figure 5: Two clusters chain states 



We have from (9) 



and 



i 



p-i 



6-4p 
For the average velocity of particles we have 

2p — p 2 

v = 

3-2p 



k(i) = 2. 
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Figure 6: Three clusters chain state 







r 






Figure 7: Pass to the other lane is forbidden 
8. Exact solution for the hexagon 

Let us designate the state of chain by sequence of zeros and ones. One on the i-th place 
means that for this state there is particle in the i-th cell. 

Let us consider the case n = 6, m = 3. There are 20 states of the chain. Among them 
there are 6 one cluster states. These states are 

(1, 1, 1,0, 0, 0), (0, 1, 1, 1, 0, 0), ... , (0, 0, 0, 1, 1, 1) (Fig. 4). There are 2 three clusters states. 
They are (1,0, 1, 0, 1,0), (0, 1, 0, 1,0, 1) (Fig. 6). And there are 12 two clusters states (Fig. 
5). 

In accordance with Theorem 1 we have 

l-2p + p 2 



Pi 



Pi 



Pi 



20- 


- 24p + 6p 2 
1 — p 


20- 


- 24p + 6p 2 
1 



20 - 24p + 6p 2 



k(i) = 1, 

k(i) = 2, 
k{i) = 3. 
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Figure 8: Pass to the other lane with moving ahead 




Figure 9: Pass to the other lane without moving ahead 

9. Generalization for the case of the multi-lane movement of 
particles 

Let us describe the model in which the movement of particles on two lanes occurs in 
accordance with the rules analogous to rules described in [5]. 

Let us consider two closed chain of cells (two lanes). There are n cells on every lane. 
Each cell corresponds to pair of numbers (i, j) , where j is the number of the lane (j = 1,2), 
and i is the number of the cell on the lane, i = 1, . . . ,n. The movement of particles occurs 
in accordance with the following rule. 

If the cell, following the cell containing the particle, is free then the particle comes to 
the following cell with probability p. 

If the cell, following the cell containing the particle, is busy and it is busy also the cell 
of the other lane being behind then at the current time the particle does not move (Fig. 

7). 

If the cell, following the cell containing the particle, is busy and three neighbouring 
cells on the other lane are free then the particle passes to the other lane moving forward 
to the next cell (Fig. 8). 

If the cell, following the cell containing the particle, is busy and two cells behind are 
free then the particle passes to the other lane without moving forward (Fig. 9). 
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Figure 10: Two-channel quadrangle 




Figure 11: Two-channel hexagon 

We can formulate the problem of investigation of this model. In particular we can 
formulate the problem of calculation of the average velocity of particle for the mode. 

The analogous model has been considered in [5]. The difference is that particles cannot 
pass to the other lane without moving forward and, if there are two free cells on the other 
lane, the particle passes to the other lane either the cell on the other lane behind is busy 
or it is free. It has been worked out in [5] an approximate method that can be used for 
calculation of characteristics of the system described in this section. 

The formulated problem can been interpreted as the problem of the random walking 
of particles on a polyhedron (Fig. 10,11). 

The analogous generalization of the problem can been formulated for the case when 
the number of lanes is more than two. 
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Abstract. In the present paper we prove a result concerning 
absolute summability of an infinite series. This result improved 
a previous result due to Rhoades and Savas[2] 



1 . Introduction 
Let T be a lower triangular matrix, (s n ) a sequence, and 



?;:=IXv (1.1) 

v=0 

A series Va,, is said to be summable III , , k > 1, if 

00 

£H M |Ar„_ 1 f<cx). (i.2) 

«=i 

Given any lower triangular matrix T one can associate the matrices T and T, 
with entries defined by 

n 

t ~/t.. nj = 0,1,2..., i —t —t , 

nv / j ra' ' ' ' ' nv nv «-l,v 

i=v 

respectively. With s n =^" a t A t , 

n n v n n n 

k = X ^ = X f « v X a A = X «*^» X '»- = X *«M • (i- 3 ) 

v=0 v=0 z=0 *=0 v=i i=0 

B B~l B 

7 „ : = K ~ h-\ = X f m a Ai ~ X '-i.* a «4 = X i* a A > as *n-i, n = o. (1 .4) 



!=0 !=0 1=0 



-*„ :="„ -«»-i = X "„,««/", • (1-5) 



i=0 



We call T a triangle if T is lower triangular and t m ^ for all n. A triangle A is 
called factorable if its nonzero entries a mn can be written in the form b m c n for each 
m and n . 

If we assumed that T to be factorable, then t m = a n b v , and therefore we have 

B n 

t =y* =a Y& := a B (1.6) 

bv / j Br b / j a- n r \ ,V V 

r=v r=v 
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i =t -t , = a B -a ,/b = a B -a ,B +a ,b (1.7) 

nv nv n-\,v n v n—\ / i r n v n-\ v n—\n V ' 

r=v 

= a B — a ,B = — Aa ,B , as a ,b = t , = . 

n v n—lv n-\ v' n-1 n n-\,n 

Also, we have A5 y = Z>„ , B n =b n . 

We also assume that (p n ) is a positive sequences of numbers such that 

A positive sequence (a„ ) is said to be almost increasing if there exist a positive 
increasing sequence (b n ) and two positive constants A and B such that (see[l]), 
Ab<a<Bh. 



n n 



The series ^a„ is said to be summable \R, p n | , £ > 1, if 

CO 

Yn k - l \T n -T nl \ k <o3, 

/ j | w n— 1 1 ' 

where 



1 ^ ! - 



^„=— z^ 






Rhoads and Savas[2] have used the notation \N, p n \ in order to denote the \R,p n \ 
summability. They have proved the following result 

Theorem 1.1. Let A be a lower triangular matrix with non-negative entries 
satisfying 
(i) a n0 =1 « = 0,1,...,, 

(ii) t n _ hv >t nv for n>v + \, 

(iii) na nn = 0(1), 1 = 0(na m ), and 

(iv) Z a -Kv + i| = 0(a„„) 

7/" \X n ) *s a positive non- decreasing sequence such that 
(v) A m X m =0(\), 

m 

(vi) 2>X„)|A 2 2„| = 0(1), and 

n=\ 
m 1 /? 

(vii) X a »»KI = °( X J' wAere ' = 7Yj ka ^ 

n=\ n + I k= ] 

then the series 2^a n A n is summable \A\, k>\. 



The aim of this paper is to improve the above result by weakening the condition 
(vii), and to deal with a general matrix T whose elements are positive or negative as, 
well as to study the new case in which the matrix T is factorable. 
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2. Results 

Lemma 2.1 [1]. Let [X n ) be almost increasing sequence satisfying (v) and (vi). 
Then 



|X|AA„|<» 

n=\ 

nX n \M n \<co. 



Lemma 2.2. the condition 



m \t \ r 

E\ n»\ \ f I* 
v k-\ I "I 



o(x m ) 



is weaker than (vii) . 

Proof. If (vii) holds, then we have 



Z 



\t \\t 

| nn || n \ 
-k-l 



o 



«=i X n 
while if (2.3) is satisfied then, 



v*-i 

V^i J 



Zk-IKI* = °( X J' 



«=i 



(2.1) 

(2.2) 

(2.3) 



Zl II I* X -1 \ nn\ I 1^ -.^t-1 

| nn || n | / i ' ' " ' " 



f 

n 

=zz 



4-1 \"\ n 



J I II \k \ 

_1 i U \\t 



«=1 1 v=l 



m-1 



X 



/,-! 



Axr + 



f i I, \k\ 
tj\t\ 



z ! 



X 



k-\ 



X 



k-\ 



v ■ " J 

k-\ 



= 0(l)X^|AXr| + 0(X m )X 
«=i 

= o(x m _ 1 )f t (x:j-xr) + o(xi) 

= o(x n J(xi- i -xr) + o(xt) 
= o{xt). 

Therefore (viii) implies (2.3) but not conversely . 
The following is our main result 

Theorem 2.3. Let [X n ) be an almost increasing sequence . Let \X n ) be 
sequences of numbers satisfying (v) and (vi), . Let T = (t nv ) be a factorable matrix, 
t nv = « A satisfying 



m \a h \\t 

2 MJJ^ =0(xJ 



n=\ 



|«A| = 0(1), l = 0(n\a n b\), 



(2.4) 
(2.5) 
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^\Aa n _A\-0(\a n b n \), 

v=0 
m 

H=V+1 

m 

£»*>Al K-A +1 | *=o(i), 

■r 

«-i . . 

Zla 6 llAfl ,5 J = 0(|a & I), 
| v v 1 1 n—l v+1 1 Vj « n|/' 



w=v+l 
n-1 



I--0 



then the series /la n A n is summable |r| i? A: > 1. 

Proof. We have 

7 := Yf va /I v" 1 

rt / > nv v v 



v=l 
n-1 ( 



( n \ 



= Z Z ra '- A vfevV 1 ) + £ Vfl v 



v=l Vr=l / 

n-1 



t^Xn' 



Vv=i y 
1 



(2.6) 

(2.7) 
(2.8) 
(2.9) 



= X (v + 1) ; v (Af^^v" 1 + t niV+1 ——- K + 1 



v=0 



v(v + 1) 



V + 1 ft 



«■ 


■1 


/ 


i 


^(v + 


l)'v 


v= 





V 



v~ X Aa n _ x b v X v 



Aa„ ,5.,,, A. Aa n _ x B v+x A/i v 



/ -."x n—l v+1 v -, 

v(v + 1) v + 1 



H t„a„b„A„ 



n n n n 



Y nl +Y n2 +Y n3+ Y n4 . 



In order to prove the Theorem, By Minkowski's inequality, it is sufficient to show 
that 



in 

£«*-%!< °o, i = 1,2,3. 



«=i 



Applying Holder's inequality, we have 

m m 



«=1 



«=1 



v^v + 1 , „ 

L, — tMn-xKK 

v=0 V 



m n—l 
^ X - ™ 1 k-\ X"™' 1 1 k 1 . , II * it 

^I> ZM K-AlKI 

n=l v=0 


r»-i a 

ZI Afl «-Al 
Vv=i y 


m n—l 

= oa)£(»|«A|) SKI Kaiw* 

w=l v=0 


m n-1 

= o(i)£o(i)XK| K-AlP 


M" 



A-l 



n=l v=0 
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v=0 n=v+\ 

= oa)£Kri^ri«A| 

v=l ^ v 
V=l A v 



m— I 



o(i)i; 






\k \ 



k-\ 



aK| +0(1) 



0(1)5XK| + 0(1)X„,|A„ 



z 



v*tf„ 



it A 



v=l X 



k-\ 



U„ 



v=l 
m— 1 



o(i)JX/? v +o(i)x m |4 



= 0(1). 



«=i 



n=l 



fV^-A+A 



v=0 



= 0(1)£; 



k-\ 



Za b t Aa ,B ,,A 
v v v n—l v+1 \ 



V=0 



m n—\ 



= 0(1)X^ZK| K| |aA|Aa„_A +1 | SkMK_,5 



H=l V=0 



A«-l 

Vv=0 



. *-l 



= o(i)J>A|'v| Kl Z" l a A| K_A V+1 | 



v=0 n=v+l 

v=l A v 

JL \a b \\t I \A I 

V=l A v 



/;;-! 



=o(d5: 



z 



aA, k, 



it A 



-4-1 



AU +0(1) 



;-=l -^ 
V / 

m 

= 0(l)£x v |A^|+0(l)mX m |A 

v=l 

= 0(1). 



^ I , II \k\ 

m \a h \\t 

v k-\ 
v=l ^ v 



«u„ 






n-l 



E ? v A "«-l 5 v + lA^ v 
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m n—\ \f 

«=1 v=0 -<* v 



ZK|x v 

Vv=0 



k-\ 



m \a h 11/ I m 

v=0 -A- v «=v+l 



v=0 ^ v 



= o(i)X 



v=0 



m— 1 



I 



fl AFr 



AA 



, (i X r 



k-\ 



aIaaI + 0(1) 



f I r II \k \ 



J 



V V V 



V-t-1 
=0 ^ v 



AA. 



= 0(l)XvX v A 2 ^ + 0(l)X m |A2 

v=0 

= 0(1). 



/ j | «4| / ^ \ n n n n\ 



= 0(i)X(+A|ri«A|^JrfcKirK| 



«=] 



_2L a b \\t , , 

= 0(1)7 ' " - ;' uj 



n=\ 



= 0(1), as in the case of Y n2 



The proof of the Theorem is complete. 



Corollary 2.4. Let [X n ) be an almost increasing sequence . Let \X n ) be 
sequences of numbers satisfying (v) and (vi), . Let T = (t nv ) be a factorable matrix, 
K v = Pj p n satisfying (2.4) and 



np n =0(P n ), P n =0{np n ), 



(2.10) 



f \ k 

Pn 

P P 

V n n-1 y 



fe-nf-oa), 



0(1). 



(2.11) 
(2.12) 



then the series Va„A„ is summable |i?,_p I , k > 1. 
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1. INTRODUCTION 

Let T be a lower triangular matrix, [s n ) a sequence, then 

T :=Yt s . (1) 

n / > nv v \ / 

v=0 

A series ^a„ is said to be summable \T\ , k>\, if 

CO 

ly- 1 ^/^. (2) 

K = l 

Given any lower triangular matrix T one can associate the matrices T and T, with 
entries defined by 



t =/t., n.i = 0,1,2..., i =t —t , 

nv / i ni ' ' ' ' ' nv nv «-l,v 

i=v 

respectively. With s n = ^'_ a.A, t , 

n n v n n n 

t =V? s =Tt V a-X ■= 'YaA'Yt ='YtaX. (3) 

n / i nv v / j nv / j i i / j i i / j nv / 1 mil \ / 

v-0 v=0 (=0 ;'-0 v=i i~0 

n 77-1 n 

Y n -=K -tn-l = YjnfiA~Yjn-X,flA = YjnfiA' OS t„_ ln = 0. (4) 

(=0 ;'=0 i'-O 

n 

X n'-=u„-u n ^ = Y J u„ i a i l^ i . (5) 



;=o 



We call T a triangle if T is lower triangular and t nn ^ for all n. A triangle A is called 
factorable if its nonzero entries a mn can be written in the form b m c n for each 
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m and n . We also assume that U = («.. ) is a triangle . (p n ),( a „ ) are assumed to be 
positive sequences of numbers such that 

p n =Po + P\ +- + P n ^°°' asn^co, 
2« =#o+#i +••• + #« ->°°> as n^ CO. 

If we assumed that T and U to be factorable, then t nv = a n b v and u nv = c n d v , and 
therefore we have 

n n 

t =Y 't = a Y ' Z> := a B (6) 

nv / t tit n / ' r *"n r \ / 

r-v r-v 

t = t —t , =a B —a , 7 b =a B —a ,B + a ,b (7) 

nv nv «-l, v n v n—\ / > r n v n— 1 v n— 1 n V / 

r=v 

= a n B v ~ a n-l B v = ~ Aa n-i B v , aS <*»-A = *„_,,„ = . 

Also, we have 

AB v =b v , AD v =d v , AD; l =--^—, B n =b n mdD n =d n . 

(p n ), (q n ) are assumed to be positive sequences of numbers such that 

P n =Po+Pl+- + Pn ^ G0 » OS n^> 00, 

G« = #o+#i + ••• + #« ^• G0 ' asw-^oo. 
The series V a„ is said to be summable \R, p n | , k > 1, if 

GO 

Z&-1 I A 1^ 

» l^-ll <Q0 > 
«=1 

where 

Z n =TjPi S i- 



In their paper, Rhoades and Savas [2] have used the notation \N, p\ to denote 
the |^,J9 n | t summability. They proved the following result . 

Theorem 1.1. Let (p n ) and (q n ) be positive sequences, \<k< s <<x>. Then 

\ N 'Pn\ t =>\^^n\, 



iff 
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n uk-u,q £ P s _ = Q )t 



z 



f \ 

.1-1/* In 



PnQn 

S \ Xls f 



Q Q , 



z 



&- 



<Zv^v 



Pv 



0(1), 



(8) 
(9) 



where k denote the conjugate index ofk, i.e., \lk + \lk = 1 . 
The aim of this paper is to present the following generalization 

2. RESULTS 

The following is our main result 

Theorem 2.1. Let \<k <s <co, [X n ),(jU n ) be sequences of constants. Let TandU 
be factorable triangles with bounded entries U nv = a n b v ,u nv = c n d v . Then the 
implication 

Ea„u n summable \u\, => / a„A„ summable \T\ 
flirt \ \ k ^^^^ (I? 

holds iff the following holds 



A/k-l/s 



f ' Aa n _ x b n X n ^ 







r 


f 00 


N 1/5 


Vl i-i/j « 
2Jn Aa n _ 


| 




\^n=m 


) 






\ 



z 



0(1), 



Ac,, 



d X 1 

—B v ^ + B V A 

D v D v+l > v D v+i 



f X^ 



\^J 



+ 



D v+ i M v+l j 
0(1). 



(10) 



,\lk 



(11) 



Proof. Let (u n ) and (t n ) denote the nth terms of the It/land \T\ transforms of 

n n 

'Y_ i a j M j an d Z a /^7 respectively. Then 



./=o 



7=0 



X „ : ="„ - M „-i=Z"»^/"i = - Ac „-iEA»^r 



;=0 



i=0 



Y := v — v , = > ? a /I = — Aa , > B a X 



i=0 



;=0 



By Abel's transformation, we have 
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Y n =" A «»-lZ I) ,«v/' l 



Bl 






v=I 
n-\ ( v 



v=l V r=l 



X 



v=l A C v -i V 



D u 

v "v 

X B 



( « 



-Afl. 



ZD a a 
v v"v 



Vv=l 



6 A 



Aa ,Y^- Afo-'b ^ + ^A 



A., 



+ ■ 



ft.. X 



D v+ i y"v 



nr*n 

Aa. 



+iy 



6 A 



Ac ,J // 

M— 1 nr*n 



X 



B-l 1 

= -Afl»-iE 



v=i Ac v _! 



rf.. „ A v 1 „ , 

-5„ — + BA 



U,^ 



D D +, v u D 

v v+l r*v v 



+ 1 



/"v 



+ ■ 



ft, X 



v+l 



VA'vy 



D v+ i y" v+ i y 



X. 



f Aa n _ { b n X n A 



A C n -l d nM. 



X„ 



n J 



.Define 



then, we have 



T^* 1-1/* T^ TT* 1-1 /« TT 



r n —n"»AaJZ-!- 

v=i Ac v _, 



rf /I 1 

5 — + S.A 



A A A 



D D , v u D 

v v+l r*v -*^v 



■+1 



v/'vy 



+ - 



6.. A, 



^v+1 /" 



X„ 



v+i y 



- n 



Aa ,bX 

n—\ n n 

Ac ,d Li 



x.. 



Therefore 



where 



K = 2>„X 



-n 



i-i/.s- Aa„_! 



Ac,, 



d X 1 

-5„ — + BA 



r x^ 



D v D v+l ju v D v 



\M vJ 



+ - 



ft.. A 



v+l 



^v+i /'v+i y 



1/A-l/s 



A Aa„_ 1 ft„A H A 

A Cn-ld nMn 



o, 



, 1< V< ft 



V = ft 



V > ft. 



(12) 



Then |[/| of ^a„// n implies |r| of '^ j a n X n is equivalent to 



314 



SULAIMAN: ABSOLUTE SUMMABILITY OF SERIES 



IK 



.1* 



< 00 



EM' 



< 00 . 



The above means that A : /* — > I s , where A is the matrix whose entries are defined by 
(12). We may write A = B + C, where 

b = Kv> l<v<n, 
[0, otherwise 
and C is the diagonal matrix with c nn = a m . 

From Theorem 2(ii) of [1], a factorable matrix with nonzero entries a nv = b n c v is a 
bounded operator from l k to I s iff 



Mk 



V«=m / v v-i y 



0(1), 



(13) 



where k* is the conjugate index of k. 

By applying (13) to B, using (12) we obtain B:l k — >l s iff 



I 



1-1/, A «„-l 

— « 



Ac 



»-i / 



A 


Ms 


f 
m 

I 






v=l 



d A 1 

— 5 V — + B V A 

D v D v+l > v D v+] 



'^ 



y" 



+ - 



ft.. A. 



V-"vy 



^v+1 /Vl 

= 0(1). (14) 



Now we have to show that for £ < s, C = \c m ):l k — > I s iff (c nn ) is bounded. 
As k<s, C:l k ->/'. That is 



II 

V»=i 



<oo, for every (s n )e/*. 



(15) 



From (15), we conclude that (c m )e/ v , where 5* is the conjugate of s. This shows that 
(c nn ) is bounded. Conversely, if (c m ) is bounded, since k < s, we get C : /* — > I s . 
Therefore A = (a nv ):l k -^T iff (10) and (11) holds. This completes the proof of the 
Theorem. 



Remark. It may be mentioned that Theorem 1.1 follows from Theorem 2.1 by putting 

q n Qv-\ - Pn P v-l 



zZriz~n—l 



P P 

1 n 1 n-\ 



, A n = jU n =1 for all n. 



3. APPLICATIONS 
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Corollary 3.1. Let 1 < k < s < co, (X n ) be a sequence of constants. Let T and U be 
factorable triangles with bounded entries t nv = a n b v ,u nv = c n d v . Then the implication 

Ea„ summable \U\, => / a„X„ summable \t\ 
n I I k t—i n n I I s 

holds iff the following holds 






Us 



El 1-1/* A 
\n Aa n _ 



\n=m 



I 



Ac 



v-l 



d„ 



0(1), 



(16) 



Uk 



b, 



DO. 

V v v+1 



BA+ BAA + ^—A 



D 



D 



v+l J 

0(1). 



(17) 



Proof. Follows from Theorem 2.1 by putting jU n = 1, for all n. 



Corollary 3.2. Let \<k <s <co, (/u n ) be sequences of constants. Let TandUbe 
factorable triangles with bounded entries t nv = a n b v ,u nv = c n d v . Then the implication 

Za„u„ summable \u\, => / a„ summable \t\ 
ft * ft I A" ^^^^ "Is' 

holds iff the following holds 



Alk-lls 



A a n ~A 



f 

\n=m 



.Us 



Zl 1-1/* A 
\n Aa„_! 



z 



Ac,, 



A c n -id„M n 
d 



0(1), 



V AA + , 



5„— + —BA 



f \ A 



M v D 



v+l 



vfty 



+ - 



1 



D v +1 M v+ i j 
0(1). 



(18) 



,Uk 



(19) 



Proof. Follows from Theorem 2.1 by putting A n — 1 for all n. 



Corollary 3.3. . Let 1 < k < s < oo, (/l n ),(//„ ) 6e sequences of constants. Let T 
and U be factorable triangles with bounded entries t nv = a n b v ,u nv = c n d v . Then the 
implication 

2_ J a nl u n summable |C/| =^> £_ j a n A n summable |j| 
/jo/Js iff the following holds 



Ac ,d li 



0(1), 



(20) 
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r 


( OO 




\l/k 


I|»' 


-Ilk . 

Aa n _ 


1 




\n=m 




) 








\ 



,\\lk 



z 



AC V _! 



d A 1 

S— + B.A 



f i A 



D D ' u D 

v v+1 r*v v 



A, 



y" 



+ 



v"»; 



D v+ l /"v+1 J 

= 0(1). 



(21) 



Proof. Follows from Theorem 2.1 by putting s = k. 

Corollary 3.4. Let l< k < s <co, \X n ) be a sequence of constants. Let U be a 
factorable triangle with bounded entries u nv = c n d v .Then the implication 

Za„ summable \u\, => / a„l„ summable \R,q„\ 
ft \ \ K ^^^^ \ \ S 

holds iff the following holds 



1n\ 



Q Ac ,D 

■e~-n n-\ n 



0(1), 



(22) 



s 



is q„ 



QnQn 



s\ 



Mk 



I 



Ac 



v-l 



''" Q^+%^^-^-^ 



v A-A*. 



D 



v+1 



D 



v+1 J 

0(1) 



Proof. Follows from Corollary 3.1 by putting 



(23) 



T = (R,q n ), Aa n _ { 



In 



QnQn, 



, s v =Q vl - 



Corollary 3.5.. Let 1 < k < s < oo, [ju n ) be a sequence of constants. Let Tbe a 
factorable triangle with bounded entries, t nv = a n b v . Then the implication 

Za„u„ summable \u\, => / a„ summable \t\ 
flirt I Nt ^^^^ II? 

holds iff the following is satisfied 



1 Aa ,b P^ 

n-l n n 
PnMn 



0(1), 



(24) 
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/ \l/.v 

\n ^a n _ l \ 

\n-m 



I 



P P 

r v r v-l 



"■ B : + ^A 



C i \ 



P v P v -i M v P, 



\»vj 



+ - 



P V M 



v+l J 



,\Vk 



0(1). 



(25) 



Proof. Follows from Corollary 3.2 by putting 



U = (R,p H ), Ac„_ 



Pn 



P P 

1 n 1 n-\ 



, D V =P V - 
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Abstract. In this paper we give two general results concerning 
absolute summability by using matrices T and U and a sequence 
of numbers [k n ) . In fact we give the following : 

Characterization of the series Va 1 to be summable III 

^—^' n n 11/; 

(|r|) whenever ^a n ju n is summable \U\ (|t/| j, k > 1 . 
1. Introduction 

Let T be a lower triangular matrix, [s n ) a sequence, then 

(1) T:=±t nv s v . 

v=0 

A series ^a„ is said to be summable \T\ , k > 1, if 

00 

(2) ^n^fj <<x>. 



n=\ 



Given any lower triangular matrix T one can associate the matrices T and t, with 
entries defined by 

n 

I = / t ., w, i = 0,1,2..., t = t — t, 

i=v 

respectively. With s = ^ j ._ o a i A i , 

n n v n n n 

(3) t =y* ^ = Vf Val = VfllVr =V/"aJl. . 

V / n / i bv°v / i nv / j t i / j i i / j nv / j "mil 

v=0 v=0 /=0 i=0 v=i /=0 

n n-l n 

( 4 ) Y n ■= K - t n -\ = S J m a A - S t»-i* a A = S ht a A » ^ ^-u« = 0- 



;=o (=o i=o 



(5) X n :=«„-«„_, = ^« m .a,.//,. 

i=0 

we also have f w = ? vv , u n =u vv . 
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We call T a triangle if T is lower triangular and t nn * for all n. A triangle A is called 

factorable if its nonzero entries a mn can be written in the form b m c n for each 

m and n . We assume that U = \u nv ) is a factorable triangle , u nv =c n d v . We have 



Zu = c / d := c D 
nr n / > r n r 



H-1 



=u —u , =cD —c ,/d =cD —c ,D +c ,d 

nv «-l,v n v h-1 / > r n v n—\ v n—\ n 



c D — c ,D = — Ac ,D , as c ,d = u , =0. 

n v n-\ v «-l v ' n-1 n «-!,« 



Also, we have 



M) v =d v , ad; 



d„ 



D v D v+l 



, D =d . 



\P n ).(?» ) are assumed to be positive sequences of numbers such that 

p n =Po + Pi +- + Pn -^°°> a^w^oo, 

The series ^ a n is said to be summable \R, p n | , k > 1, if 

oo 

« l^-i I <G0 > 
where 

Z n =YaPi S i- 



(6) 

(7) 



i=0 



Some authors used the notation \N, p„ in order to mean \R, p\, , that is the two 

I ' r n \li I , r n \k ' 

summabilities are exactly the same. The notation A e {A,B), where A and B are 
two summabilities, means that Vfl„ summable A implies that ^ a n A n is summable 
B. 

Recently, Rhoades and Savas [2]established the following results concerning 
characterizations of some absolute summabilities. 



(i) 



Theorem 1.1. Let 1 < k < <x> . .Then A e vN,p n \,\T\ J iff T satisfies the following 
-l = (v 1/ ") 



\t A 



(ii) in^\A v (i nv A v f 



v i/i 



\H=V+1 



o 



f \ 
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(iii) 



Z"^%,v+aJ 



V«=v+1 



= 0(1). 



Theorem 1.2. Let 1 < k < oo. Suppose that T satisfies 

oc 

(6) 2jp OT converges for each v=l,2,... 



n-v+l 



(7) X r ""+ 1 conver g es f or eacn v=l,2,... 



77^ /U^,/>4,fr|)# 



(i) 



I: 



l 

1 



00 P / N 

/ > V \ HV V / rt,V+l V+ 

n=v+l 7y 



< GO 



(ii) s 



v=l 



'w^A 



Pv 



< 00, 



where k' is the conjugate index of k . 
The following Lemma is needed for our aim 



Lemma 1.3 [1] . Let 1 < k < oo. 7%ew a« infinite matrix T :l — > / A iff 



sup^K 



< oo. 



and U = (u nv ) . In fact we intend to prove the following 

2. Results 

Theorem 2.1. Let \<k<<x>. Let the matrix U = (u nv ) is factorable, that 
isu„„ = cd„. Let 



nv n v 



(8) 



GO 

Y\Ac ,d | = 0(|Ac ,D I). 



Then the implication 

2_j a „ is summable |t/| => 2^a n A n is summable \T\ 
holds iff 



(i) |Uv| =0^v 1/w |Ac v . 1 D v | ) 

(ii) ±n*-y v (t n A v ) k = o{Ac v _ lDv \ k ) 



n=v+\ 
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(iii) IX1CA 



O 



\D +] \Y\Ac , 

| v+l I / ' I n-\ 



V «=v+l 



Proof. By (4) and (5), in order to prove the theorem, we have to show that 



(9) 

whenever 

(10) 

For k > 1 define 



11 \ Y n\ 



<00 



< CO. 



B = Ua i ):2_ j a i is summable |t/| 



C=yz i y.y^a i Jl i is summable |r| ) . 
These are Banach spaces, if normed by 

( n ) IWI = ZW> 



,i/t 



(12) 



\\Y\\ 



v + > « 7 



Since ^a n //„ is summable |C/| implies that V a n X n is summable |r| , by the 
Banach- Steinhaus theorem, there exists a constant TV > such that 
(13) \\Y\\ < N\\X\\ 

for all sequences satisfying (10) . 

Now, applying (3) and (4) to the sequence 



a v = e v > a v+i = - e v+i » a „ = ° otherwise , 



when e v is the v - th coordinate sequence, we get 

0, « < v, 

X„ =< 






« = v, 

« > V, 



Using (11) and (12), 



Pi 



^| = |Ac v _,D v |+ X |Ac„_^ v | , 

«=v+l 




( V °° / \ fr ^ 

v^Af + z^-'MuT 

V «=v+l / 



1/4 



Therefore, it follows from (13) that 






n-v+1 
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As the above inequality holds for every v > 1, we obtain, by (8) 

The above inequality is true iff each term of the left side is 0(|« vv | I. 
The left term gives 



v k -% v A\ = OMc^D 



r) 

v| /' 



or 



Li. I = G\v Uk - 1 \Ac v _ 1 D v \ ), 



that is 



>(v^\Ac v _ lDv \). 



\t,M =0\v Uk - l \Ac v _ l D, 



Therefore (i) is necessary. On taking the second term, we obtain 

fViAff x\ k =o|Ac ,D\ k ). 

/ j | \ nv v A \| v-1 v | / 

n— v+1 

which is condition (ii) . 

It remains to prove the necessity of (iii), we again apply (3) and (4), to the sequence 

with a v = e v+l to obtain 



X. 



Y 



0, 



n < v + 1 



\-Ac n _ y D v+ , n>v + l 



0, 



n < v + 1, 



K.v+i^v+1. n>v + \. 
By using again (11) and (12), we obtain 

GO 

\X\= Z\ Ac ^ D J > 



\\Y\\ 



From (13), it follows that 



» |'„,v+A + l| 

V«=v+1 



( 






V 



v+1 

V«=v+i y 

/ ~ \ fc 

=0 |A + i|ZK-il 

V «=v+l 



o 



Vn-v+l 



which is the necessity of (iii). 

In order to prove the conditions sufficient, we have from (4) 
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y»=i^, 



v=l 
n-\ f v 



t _nAv 

D„ 



v=l V r=l 

tT Ac,, 



LA 



+ 



Z D v«v 



A I 



f_A 



Z) 



V^v 



A (i a) 

V \ HV V / 



"*" n r> «,v+i v+i 

v v+1 



X JnnK 
AC n-l d n 



Set F* = « W/A F„ .Then we have 



^ 1-1/*? o A 

Ac..,/), , 



X„ 



We are writing F n *=Va nv X v , where 



v=l 

1-1/* / 



Ac,, 



V^ 



A (f /I )+- 

v V nv v / 



</.. 



^W + l 



^K.V+l^V+l 



.1-1/ 



* Cjv 
Ac v _,Z) v 



0, 



i/ 1 < v < » - 1, 

if n = v, 
if n>v 



< 00. 



The statement that Ya„l is summable III , A: > 1 whenever Yn is summable 

^^U n n I I A: ^^^ '' 

\l/\ is equivalent to 

^ \Y*\ < oo whenever Xl^«l 

or equivalently 

supXKT <g °- 

By Lemma 1.3, it follows that 

* 
t,„A, 



I 



i \ k k-\ 
\a„„\ -v 



Ac v _A 



+ 



E» w 



Ac,, 



V^v 



A (t A ) 



d„ 



1 ^n.v+l^v+l 



DD 



v+l 



Clearly conditions (8), (i)-(iii), via minkowski's inequality implies that 

oo 

zkr=oa), 

n=v 

as v — » oo. The proof is complete. 
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Theorem 2.2. Let 1 < k < oo. Ze? T satisfies (6) and (7) a«J £/ is factorable 
triangle, u nv =c n d v , and 



(14) 



k. 



0(1), 



^W + i 



=oK-il) 



Ac v _A 

Then the implication 

2_ l a nl u n is summable |C/| =^> 2^a n A n is summable \T\ 

holds iff 



<i) I 



1 

,-1 v 



1 



en) z 



2 A, 

n=v+l ^t-v- 



V^v 



A (f /I ) 

v V «v v / 



+ - 



d„ 



D v D v+l 



Vv+iAm-I 



< 00 



Ac^A 



< oo, 



where k' is the conjugate index ofk 



Proof. As before, we have 

n-\ 1 ^ 



v-l A ^ v -1 



V°v 



A (f A ) 

v V nv v / 



*. 



"*" r> n ",v+i v+i 



X. - 



nn n 

v Ac «-A y 



X„ 



Set X:=n l - llk X n , Y n =^a„X 

v=l 

where 



.1/4-1 



f 



Ac 



1_ 
D, 



A (i A) 

V V HV V / 



+ - 



-V 



0, 



v-l V V 
l/k-V Kv^v 



D v D v+l 



*n,v+\\+\ 



&c v _,D v 



if 1 < v < /i - 1, 

if n = v, 
if n>v 



The condition that '^ j a n A n is summable |7l whenever Z a » is summable |t/| 

equivalent to V \Y n I < oo whenever V X* < oo. The necessary and sufficient 
conditions for this implication are 

cc 

(15) Z a „ v z v < °° f° r eacri bounded sequence z = (z v ), v = 1,2,... 

and 



is 
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(16) IIv 

v-1 n-v 

To verify (15), we have 

00 

Ea z 



< oo for each bounded sequence z . 



y l/*-l ? vvA> z 

Ac v _ xJ D v v 



00 1/t-l 



«=V+1 '"^v-l V 



I ^- ^A,(U> 



D 



AA* 



'*B,v+iAm-1 



Now, 



I 



,1/t-l 



Ac 



D 



-A (f /I ) 

v \ ov V / 



v-1 V v 

1/Jt-l 00 



< JV, 



Ac v _[Z) v | „ =VH i 



2jf»v v 'u.v+lA'+l 



< N-, 



^ C v-l^v|V «=v+l 



A vlEfcv|+K + ilZI^ 



v+l 
o=v+l J 



0(1), 



by (6) and (7), where M is bounded for z . Also 



I 



.i/t-i 



Ac v _, 



*. 



vAA + i 



< AV 



Vv+iAm-I 



rf v 4», 



Ac ,D D , 

V-1 V v+l 



IX 



= 0(1), 
we obtain (15) satisfied . 
From (16), the necessary and sufficient conditions for the inclusion of the theorem is 



(17) I 



0=1 



1/4-1 ^wA 



oc 1/i-l 



Ac v _! 



X T— ^,(U)+T7-U 






D D 



n,v+l v+l 



< 00 



For each bounded sequence z . From (17) by choosing z n = 1 for each n it follows that 



(18) 



(19) X 



I 



l/t-l 'w v> 



V 



v=l 

00 1/t-l / 



Ac,_,0, 



I 



V 



Ac,, 



«=V+1 ^^^y-l 



= 0(1) 
1 . /» „ \ </.. 



V^v 



A (i X )+- 

v v nv v / 



AA + > 



Vv+iAm-I 



= 0(1), 



which are conditions (i) and (ii) . 

(i) and (ii) are also sufficient via using Minkowski; s inequality along with (18) and (19), 

since (17) holds for every bounded sequence z = [z n ). 
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Remark 2.3. The two results of [2] can be obtained from theorems 2.1 and 2.2 by 
putting 

U = {N,p n ), u„=Z&±,-hc^=-£-,D y =P^. 



Corollary 2.4. Let 1 < k < oo. Let the matrix U = (u nv ) is factorable, that 
isu nv = c n d v . Let (8) be satisfied . Then the implication 

Za„ is summable \u\ =>) a„ is summable \T\, 
11 I I y ' n 11/; 

holds iff 

0) \L\ =o(v 1/ "|Ac v _ lJ D v | ) 

(ii) ±n^\A v {Q k =o\Ac v _,D v \ k ) 

n-v+1 

GO , / OO \ 

(iii) Yn k - l \i J =0 Id ,JY|Ac ,1 . 

V / / j I «,v+l I I v+1 1 / j | tt-1 1 

n=v+l V. «=v+l / 

Proof. The proof follows from theorem 2.1 by putting X n - 1, Vw. 
Remark 2.5. Concerning the summabilities \N, p„\ ,\N,q\ , it may be mentioned 

\\k\\k 

that many other results can be obtained from theorems 2. 1 and 2.2 by putting 
T = (N,p H ) and U = (N,q H ). 
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1 . Introduction 

Let T be a lower triangular matrix, and (s n ) a sequence. Then 

(1) T n := £cv 

v=0 

A series ]T a n with partial sums s n is said to be summable \T\ , k > 1, if 

CO 

(2) ^n^-Tj^, 

n=\ 

and it is said to be summable \T, S\ , k > 1, 8 > 0, if 

CO 

n \ T n- T n-i\ <co - 



With T, two lower triangular matrices T and f are associated as follows 

n 

C=2X n,v = 0,1,2...., 



(3) 



i =t —t, n — l,2,. 

nv nv n—l,v ' ' 



we may write 

(4) T =Yt YaA=YaAYt =Yt a X 

V / n / j nv / j r r / j r r / i nr / j nr r r 

v=0 r=0 ^=0 v=r r=0 

Thus 

n n-\ 

(5) T -T , = Yt a X -Yt , a X 

V / n n-\ / f nv v v / j n-\.v v v 



n v n n n 



v=i) 



Yt a A (t , =0) 



v=0 
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Eta A (i X ) + Ya t X (i =t ) 
/ i r v V nv v / / j v nn n \ nn nn / 

i-=ov=o y v=o y 

= Vi A f X + i ^AXi + st X 

/ t v \ v nv v n,v+l v / n nn n 



v=0 

- t _i_r _i_r 

J «l TJ «2 TJ ii3' 

Let (p n ) be a sequence of positive numbers such that 

Pn=Po + Pl + - + Pn-> CO aS «^ GO , P_i=P_i=0. 

In the special case when £ nv = /? v /P B , the summability |7J is called \R,p n \ . 

A positive sequence (a n ) is said to be almost increasing if there exists a positive 
Increasing sequence \b n ) and two positive constants A and B such that 



Ab n <a n < Bb n for each n . 
A positive sequence (/„) is said to be quasi /? -power increasing sequence if there 
is a constant K = K(j3,y)> 1 such that Kn p y n > m p y m holds for all n > m > 1. It 
should be mentioned that every almost increasing sequence is quasi (3 -power increa 
-sing sequence for any (3 > 0, while the converse need not be true as for example 
y n =n- p , /?>0. 

By a triangle we mean a lower triangular matrix with all principal diagonal entries 
non zero. 

Concerning almost increasing sequences, Savas [2] gave the following result 

Theorem 1.1. Let \X n ) be an almost increasing sequence and let \fl n ) and \X n ) be 
sequences such that 

(6) | A/l„ |</? n , 

(7) lim„/?„=0, 

( g ) z>hA|*.. <o0 ' 

(9) K|X„=0(1), 

are satisfied. Let T be a triangular matrix with non-negative entries satisfying 

(io) nt m =o{i) 

(11) '„-i,v*C /or «>v + l, 

(12) ^„ = 1 far all n , 

n-\ 



(13) Z'vAv + l=°(0> 

v=l 
m+1 . v 

(i4) 2>*v; v = o(v*0, 



rt=V+l 
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(15) X w *'».v+i =0 ( v *)' awrf 

n=v+l 

d6) 5L«*->.r=o(jrJ, 

?Aen ^e series V a„/l„ is summable \T,S\,, k>\, 0< S <\/ k. 

Since quasi /? -power (0 < /? < l) increasing sequences are weaker than almost 
increasing sequences, it is true , in order to have better results, replacing almost 
increasing sequences by quasi fi — power increasing sequences. Not only that, in 

fact our aim is to improve as well as generalized the result [2] in the following 
sense 

1 . Our result deal with a general series V a n with negative and positive terms 

2. The condition imposed on (X n ) is weaker. 

2. Results. 



Lemma 2.0. Conditions (6)-(8) imply 

CO 

lAA = o(i). 

n=\ 

Proof. Method 1. Since f3 n — » 0, then, we have 

00 00 CO CO v 



n=\ 



n=\ v=n 



v=l n=\ 

-p 



= 0(\)^\ApyX v ^n 

v=l n=\ 

oo v 

= 0(l)X|A/? v KxJ M A/ M 

v=l o 

CO 

= 0(l)£v|A/? v |X v =0(l). 



v=l 



Method 2. As 

CO CO CO 

mXJ m =mX m Y j AP n =m^m (i X m £a/J„ = O^m^^ X n \^ n \) 

n=m n=m n=m 

00 

= 0(1)X« 1 ^^„|A^| = 0(1), then 

n=m 
m rn-1 f n \ f m \ 

Ea*.=X IX aa,+ 2X a 

«=1 «=1 Vv=l / \h=1 ) 

m—\ f n \ f in \ 

n=l V v =l / V«=l / 

m f n \ f m ^ 

= 0(1)£ n'X u Yv- p Afi n +OQ)m'X m £»"" /? m 



Vv=i y 



v»=i y 
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= 0(l)£«XjA/?„|+0(l)mX„A =OQ). 



We state and prove the main result 

Theorem 2.1. Let \X n ) be a quasi f3 -power increasing sequence, < (3 < 1, and let 
\fi n ) and \X n ) b sequences satisfying (6)-(9) . Let T be a triangular matrix satisfying 



(17) 
(18) 

(19) 

(20) 

(21) 



4J = o(i), 

CO . . 

ZW-1L I* -1 1 a 7 I a| AL I! 
I ran I v nv \ | w|/' 

n=v+\ 

n=v+\ 



v=0 






Zften the series ; a„X„ is summable \T,S\,, k>\, $<S<\lk. 



In addition, the following shows that condition (21) is weaker than (16) whenever 
\X n ) is almost increasing. For if (16) holds, 
then, we have 



n 



.*-! \ n\ 



■k-\ 



= 



- 1_ 

k-\ 



\ X \ J 



while if (21) is satisfied we have 



m 



«=i 



Z*-i| I* V 
n M =2- 



« J — r-r^„ 



«=i 



«=] 



X 



t-i « 



m—\ 



n = l 



i* A 



I 



«-l Fv| 



X 



/c-1 



AX*" 1 + 



i* A 



2> 



A-i r«| 



X 



i-i 



X 



k-\ 



m-\ 



= o(i)Vi „ ax*- 1 + o(x)x k - 1 

n=\ 

= o(x ffl jgfc;-xr) + ofc) 



n=l 
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= o(xt). 

Therefore (16) implies (21) but not conversely 



Proof of Theorem 2.1. It is sufficient, by (5), and Minkowski's inequality, 
to show that 



Applying Holder's inequality, we have 

m+\ m+1 f n— 1 

Z„3c+k-l\rp \ k ^ TT „Sk+k-\ VU 7 ll 3 IL I 
77 i , S > w > A t \\A \\s \ 

I "II / j / j v nv M v 1 1 v | 



«=1 
m+\ 



\v=0 
( n-\ 



n=\ 



\ 



ZSk+k-\ V 1 ! A 7 111 1*1 r \~Ma ; 
n ? \L-\ t \\A \ \s \ 7 \A t 

/ i \ v nv\\ v\ | v| / j y^f? 



Vv=0 



/^n-1 



\ 



A— 1 



n \t 7 \A t \\A \ \s 

\ nn\ / > v nv v| | v 



J\y=o J 

k\ \k 



n=\ 



i-=0 



m+\ 



(22) 



n/i^VI Hi I' V Sk+k-l\. \ k - l \ A 2 | 

= °^)ZJ S A \K\ L n K\ | A Av| 

v=0 n=v+\ 

=o(i)tv*^n^r^i 

v=0 
m 

r\(A V 1 «-l I 1*1 i I* 



v=0 



m 

= o(i)S 



.<*-! v 



v=0 



m-1 



X 



/<-! 



(*.wrw 



= 0(1)2 



!• = () 



i/fc A 



X 



.<*-! P 



X 



/,-! 



aU.I + 



\k \ 



Z< 

1--0 



.<*-! v 



X 



/(-l 



U„ 



= o(i)X^K| + o(i)x ffl |i„ 



v=() 
m-1 



= o(i)Xx v /? v + o(i) 
= o(i), 



v=0 



" \ T n2\ ^ L 



m+1 / w— 1 

4 - V Sk+k-\ 

n 



m+1 



<X+/t-l 



v=0 

1 

Z\t Ik I/? 



n=\ \v=0 

m+\ f «-l \ k 



Vv=0 



k-1 



s V" 1 3t+k-l v~* It 



\k \s„ 



n=i 



"+1| T^A-l 

^v 



/ m-1 \ 

Vv=o y 



k-\ 
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m \a m+\ 

V-0 -A- v H=V+1 

m ci 

= 0(l)Zv*- lJ ^rvA 



=0 



vl 



= 0(1)Z 



it A 



r=0 



Sk-\ \ S r\ 



X 



k-\ 



|a(v/?J+0(1) 



\k \ 



5k-\ \ S v\ 



v=0 



X 



k-l 



™Prr, 



= 0(l)£x v (-^+(v + l)A^) + 0(l)m^X m 

m m 

= 0(1)£/? V X V + 0(l)£v|A/? v pr v +0(l)mfi u X a 

= 0(1). 



v=() 



v=0 



m m 

Z„Sk+k-l\ T \k , ST 1 sk+k-\[\. II] II If 



k I \k 



=o(i)X«*- 1 KrK 

= 0(1) 



«=i 



as in the case of (22) . This completes the proof of the theorem 



If Theorem 2.1 is restricted to a series of positive terms, then the result can be 
stated as the following 

Theorem 2.2. Let [X n ) be a quasi (3 -power increasing sequence and let 
[J3 n ) and \X n ) be sequences satisfying (6)-(9) . Let T be a triangular matrix with 
non-negative entries satisfying (10)-(12) and le t(\4), (21), and 

(23) 2^ n F»,v+i| =°l v j» 

n=v+l 

6e satisfied. Then the series ^ a n A n is summable \T, S\ , A: > 1, < J < 1 / k. 

By making a comparison between Theorems 2.2 and 1.1, we have 

1 . Condition (21) is weaker than (16), 

2. Condition (23) replaces the two conditions (13) and (15). 

This probably implies that this special case of Theorem 2.1 is better than Theorem 1.1. 

Proof of Theorem 2.2. It is sufficient to consider I x only. Observe that conditions 

(11)-(12) imply f>q = 0(O (see [2]). 



v=0 



333 



SULAIMAN: SUMMABILITY FACTOR THEOREM 



( n-\ 



" l r »il - iJ 1 L* A vC \\K\\ S 



m+\ 
«=1 



Vv=0 
f ' n-\ 



Sk+k-1 



\ 



A U Ls > A t 

\ v nv M v | | v| / j v^j7 



Vv=0 



I^H-l 



yvv=o 



A— 1 



n (nt > \A t \u\ \s 

\ nn / / j v «v | v\ | 



«=1 



v=0 



m+1 



v=0 «=v+l 

= 0(1)^*^1*1^1*^ 

v=0 

=o(i)tv*-> v rw 4 

v=0 

= 0(1), 
as has been done before . 

Theorem 2.3. Le£ (X n ) be a quasi (5 -power increasing sequence and let 

\fi n ) and \X n ) be sequences satisfying (6)-(9) . Let T be a triangular matrix 
satisfying (20)-(21), and 

CO 

(24) Yn k - l \t t'lAf I = O (k I, 

V / / j \ nn\ v bv Vj w|/' 



(25) 



z» w iur=o(i). 



Then the series ^a n A n is summable |r| , £>1. 
Proof. The proof follows from Theorem 2. 1 by putting 8 = 0. 



Corollary 2.4. Ze£ (X B ) be a quasi (3 -power increasing sequence . If 
\X n ) and [J3 n ) satisfy conditions (6)-(9), and if \p n ) is a sequence satisfying 



(26) 

(27) 



'■P.=0(P n ), 



n=v+\ 



,Sk-\ 



= 



«-l 



.<* 



vy 



£/zen £/ze series ^a n A n is summable \R, p n | , A: > 1 . 

Proof. With T = (R,p n ), that is C= — , and f BV = ^" J" 1 , all of the conditions of 



P P 

1 n 1 n-\ 



Theorem 2.2 are satisfied . In fact 



'n SK+k - l L 



in 

-I' 



&+/t-i 



«=V+1 



I'+l 



PnPv 
P P 



III 

= o(ik*2> 



<*-l 



n-1 
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2> 



0(l)^r I ' 

* v n=v+\ 



k a? 



A-l 



H-l 



= 



f k\ 

.Sk Pv 



= o(v*). 



v y 



2> 



<*+*-! 



y A 



A-l 



P 



= 0(l) Pv ^Tn 



A. 



-1 1 



o 



PnPv 

P P 

1 n 1 n-\ 

r \ 

v 5kPs 



v 



0(v^J. 



v y 



Note. Concerning Corollary 2.4, a similar result has been obtained in [2], using the 
condition 



(28) 



I" 



,* 



Pn 



P P 

1 n 1 n-\ 



= 



( v *\ 



v^y 



But condition (27) is weaker than (28) . ( The two summabilities \N, p n and \R, p n | 
are the same). 
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Abstract 

We consider a class of nonstationary time series denned by Y t — 
fit + X^^lo ^t,jfft—jf]t—j where {rjt; t G Z} is sequence of iid random vari- 
ables with regularly varying tail probabilities, a t is a scale parameter and 
{C t ,j, i £ Z, j > 0} an infinite array of random variables identically 
distributed. We study an asymptotic tail behavior for (It). 
Key words and phrases : Tail behavior, Regular varying function, 
Nonstationary process. 
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1 Introduction 

In recent years, modeling extremes of environmental time series has been the 
purpose of many investigations because of its wide applicability to the analysis 
of phenomenon such as extreme temperature, flood, storm winds and extreme 
ozone concentrations. See Horowitz ([6]) who considered the following model 
for daily ozone maxima {It}: 

log(F t ) = f(t) + (t 

where /(£) is a deterministic part, such as a seasonal component or trend, and 
£ t is a normal stationary autoregressive process. Ballerini and McCormick ([T]) 
studied the limit theory for processes of the form Y t = f(t) + h(t)Q where h(.) is 
positive and periodic and {£ t } is a stationary process satisfying certain mixing 
conditions. Niu (|8]) studied the limit theory for extreme values of a class of 
nonstationary time series with the following form 



oo 



Y t =Ht + X t , X t = 2_^ c k T} t -kOt-k (1-1) 

k=0 
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where at is a non random positive constant and {( t } is a sequence of iid random 
variables with regularly varying tail probabilities. 



In this paper, we are interested in a nonstationary moving average process 
with random coefficients. The object of the paper is the determination of the 
tail behavior of the process (X t ) t and appears as a direct extension of the results 
of Resnick and Willekens ([12]) and Kulik ((?]). 



The exposition proceeds as follows. Section 2 describes the model, gives some 
examples and assumptions are provided. Section 3 contains the tail behavior of 
the process (X t )t. The marginal distribution of (X t )t has Pareto-like tails. 

2 The model 

Some extreme value data, especially in environmental contexts, often exhibit 
some stylized facts (see Coles (J3]), Eastoe and Tawn (0)): 

• dependence on covariate effects 

• short term dependence (storms for example) 

• seasonality (due to the annual cycle in meteorology) 

• long-trends (due to gradual climatic change) 

• other forms of non-stationarity (switching regime due to weather regimes) 

To take into account these facts, we introduce a class of nonstationary time 
series defined by the following relations 

oo 

Y t =iH + Xt, x t = J2 Ct.kVt-kcrt-k (2.2) 

k=0 

where {r] t ; t £ Z} is sequence of iid random variables with regularly varying tail 
probabilities, at is a scale parameter and {Ct.k, t £ Z, k > 0} an infinite array 
of random variables identically distributed called weights. Our goal is to study 



the tail behavior of the process defined in (2.2) 



We may give an example of model (2.2 I for, say, ground-level ozone data 
{X t } defined by the following relation 

x ^ \ (piXt-i + aur]^ , if W t -s>T, - 23 . 

' \ <hXt-i + <T2tVt 2) , if W f -s<T, 

where r and fa are non random constants and with threshold variable W t -s- 

(i) 

The sequences i] t ! , i — 1, 2 are sequence of iid random variables with regularly 
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varying tail probabilities. The ground level ozone process has piecewise linear 
structure. It switches between two first order autoregressive process accord- 
ing to meteorological conditions, including daily temperature, relative humidity 
and wind speed and direction, which play an important role in determining the 
severity of ozone concentration. 



In hydrological framework where the water level {X t } is observed at a given 
location, Wt-s could be interpreted as threshold level upstream from that loca- 
tion and 6 the delay (in terms of days, hours, for instance) for the raw wave to 
reach that location. 

• The dependence on covariates effects can also be modeled by considering 
the scale parameters an, i = 1, 2 as a nonlinear function of meteorological 
variables of the form 



a lt = exp < ff i0 + y^ foxy 

• To allow for a seasonal component (annual for instance) in the variance, 
we could use 

J ^ (2njt\ a , f2irjt" 

a it = exp i a l0 + ^ Oij cos I — 1 + /% sin I — 

• To allow for long trends due to gradual climatic change, we could use 

Mt = a o + ait. 



We define I u — l{w t -s>r}: ^it = 1 ~^xt- The model (2.3 1 can be written as 

X t = ^ (t) X t _! + Z t (2.4) 

where 

4>(t) = <t>iht + faht and Z t - cr lt 7y t (1) / lt + a 2 tVtht- 



The equation (2.4) is a stochastic difference equation where the pairs (</>( t ), Z t )t 
are sequences of independent and not identically distributed E 2 - valued random 



variables. The solution of (2.4 1 can be written as 



*t = £ [U^t-kAZt-j (2.5) 

i-=0 \fe=0 / 



We will use the following assumptions. We assume that the absolute value 
of each weight Ct.k has an upper endpoint Ck defined by 

c k = sup{c: P(|Ct,k| < c) < 1}, fc = l,2,.... 
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Assume the following conditions hold: 

Hi— The sequence of random variables {r/ t , t £ Z} is a sequence of independent, 

identically distributed (i.i.d.) random variables and satisfy: 

P(|r?i| > x) = x~ a L(x), a>0 (2.6) 

and 

Pfa > x) Pfa < -x) 

lim — - ; ; = 7Tn, Um —r. . r- = 1 — 7Tn . (2.7) 

where a > 0, < no < 1 and L is a slowly varying function at infinity that is 

lim L{tx) - 1 

Let a„ be the (1 — n^ 1 ) quantile of 1 771 1 

a„ = inf{x :P(hi| <x) > 1 - nT 1 } (2.8) 

H2— For all fixed t and fc, random variables Ct.k and ry t _fc are independent. 

H 3 - For some, S > ^^Li <£"* < °° and Efcli ^4° < °°- 

H 4 

1 " 

- ^2 a j -* aa as n ~> °°- ( 2 - 9 ) 

"" 3=1 

3 Tail asymptotics 

Throughout, all limit relationships are for x — ► 00 unless otherwise specified. For 
two positive functions a(.) and &(.), we write a(x) < 6(x) if limsupa(a;)/6(a;) < 
1, write 0(1) > b(x) if liminf a(x)/b(x) > 1, and write a(a;) ~ 6(aj) if both. The 



asymptotic tail behaviors for (X 4 ) defined in (2.2 1 are given by the following 
theorems. 

Theorem 3.1 Suppose that the conditions H1 — H3 hold. Then the tail behavior 



distribution of (X t ) t defined in (2.2) is : 



lim niEZoC^cr^ k \ > x) = £ E[| c n (3 _ 10) 

x^oo ¥(\i 11 \>x) f^ Q 

Theorem 3.2 Suppose that the conditions Hi — Ht, hold. Then the tail behavior 



distribution of {Y t )t defined in 2.2 



I^o P(\ m \> x ) = ^oE[\a k C ltk \ ). (3.11) 



k=0 



!im " . , , = > (1 - ttq E KCi, fe • 3- 12 

x— »oo r mi > a; * — ' 



fc=o 



We now begin the proof with two lemmas, the first is due to Cline ((2]), the 
second one is inspired by Lemma 3.1 in Resnick and Van Den Berg (jllj) 
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Lemma 3.3 Consider Z a random variable satisfying (2.6) and (2.1), and Y is 
another rani 
5 > a. Then 



another random variable independent of Z and satisfying E[|Y| ] < oo for some 



P(ZY > x) ~ 7r E[|y| Q ]P(|Z| > a;) (3.13) 

and 

V(ZY < -x) ~ (1 - 7r )E[|y| Q ]P(|Z| > x). (3.14) 

Lemma 3.4 Suppose that Uq, • • • , U m are random variables, F is a distribution 
function such that 1 — F(x) = ¥(Uq > x) = x~ a L(x). Suppose 

lim ~i 7^r=PkCk, fc = 0, ■■■ ,m, 0<Pk<l, (3.15) 

x-+oo 1 — ±i [x) 



™ 1 _ Fix) = ^ ~ Pk ' Ck ' *• ' 



X — >OQ 



]im P(l%l>x,N> g ) = 

1 — F(.x) 



;r^oc 



i™ — n^) — = L c *- ( 3 - 18 ) 

v ' fc=0 



llm i ?T^ = °' fc ^ '' ( 3 - 19 

rr^oo 1 — J< (x) 



and 



(a)// 



then 



(b)// 



i™ !_ f(a; ) -L^- ( 3 - 2 °) 

■ ^ E ;^r" =i:c- ? .h- (3-) 

v ' fc=0 

Proof 

For the proof of (a) see [IT]. 

(b) The proof is analogous to that of Lemma 2.1 in |4J. 

We begin by showing that 

.. P(J7i + U 2 > x) 

lim ^— =PiCi+p 2 c 2 . 

Define a n such that n(l — F(a n )) —> l,n — > oo and on [— oo,+oo] define the 
measure Vi by 

Vi(dx) = p i x~ a ~ 1 lf {x>0) dx + (1 - Pi){-x)~~ a ~ x ¥( x<a )dx. 
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The definition of a n , (3.151 and (3.161 implies 



nf(a n l Yi e .) — ►„ CiVi 

nP(a- 1 (Fi,y 2 )e (.,.)) ->„A* (3-22) 

where /x concentrates on [— oo, oo] 2 /^} and for all x > 

n{(y,0) :y> x} =p 1 c 1 x~ a and /x{(0, y) : y > x} = p 2 c 2 x~ a 

l*{(y, 0) : V < -%} = (1 - Pi)ci^" a and ^{(0, y) : y < -x] = (1 - p 2 )c2£~ a - 

Now let (Y^,Y") be iid copies of (Yi,Y 2 ) and applying Proposition 3.21 in 
|9] to Q3.22) gives 



fc=0 fc=0 fc=0 

on M p ([0,oo) x ([— 00, oo] 2 /{0})) where the limit is Poisson random measure 
(PRM) on [0,oo) x ([— 00, oo] 2 /{0}) with mean measure dt x dfi. 
Now we define the map T : [0, 00) x ([— 00, oo] 2 /{0}) — * [— oo,oo]/{0} by 
T(t, x,y) — x + y. It is obvious the T is vaguely continuous, so Proposition 
3.18 of |9] may be applied to (3.231 to obtain 



CnOT-^g 



£/h 



fc=0 



(Z^in+nn) 



t° T l = H e KS k ) + Y. £ K^ 



k=0 



k=0 



where the limit PRM concentrates on [0, 00) x ([—00, 00] {0}) with mean measure 

/lor 1 . 

To evaluate fi o T _1 we compute for z > 

fioT^ 1 (z) = fi{(x,y) : x + y > z} 

and because fj, concentrates on [— oo,oo] 2 /{0} this equals 

fi{(x, 0) : x + > z} + /z{(0, y) : + y > z} = v\C\z~ a + p 2 c 2 z~ a . 

Applying again Proposition 3.21 in (9], we have 

n¥ {a^ l l {Y l + Y 2 ) > x) -+ v (p lCl + p 2 c 2 )x~ a . 

This proves the result for m = 2, the case for general m follows by induction. 
Analogously (3.21| is handled very similarly as (3.20) 



Proof of Theorem ETTl 

First, we shall show that 



l™ in,/ 1 ^ / = >,ECi,KTt-k where Z fc = a 4 _ 



fc=0 



kVk- 

(3.24) 
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By Lemma |3.3| we have 



lim 



't,kZt-k > X) 



x^co P(|t7i| > x) 



= noE[\C t ,k^t-k\ a ]- 



(3.25) 



Let e > and k ^ I 



P(\Ct, k Z t -k\ > x,\C t ,iZ t -i\ >x) < V{\Ct,kZ t - k \l{\c t , k \>e} >s)+P(|(7 M Z t _,|I { | Ctil | >e} >x) 

+ n\C t , k \ < e, \C U \ < £, \C tik Z t _ k \ > x, \C ttl Z t _i\ > x) 

< F(\C t , k Zt-k\I{\c t ,>\>e} >a;) + P(|C t ,,Z t _«|I { | Ctil |> e} > x) 

+ P(\r]t-k\ > x{a t - k £)- 1 , \r]t-i\ > x(o- t -ie)~ l ) 

= h + h + h- 



(3.26) 



By Lemma |3.3| and using Fatou's lemma, we have 

lim „/, ,* s =H\Ct,k (J t-k\ a l{c tk >e}\ ->0 as e^OO. 

x^oa P(|77l| > X) ' 

The proof of I 2 is similar to J^. 

Since r\t-k and rj t -i are independent, we have 

I 3 = o(¥(\ m \>x)). 

Combining ( |3.26| and ( |3.27| , we get 



Hm n\Ct, k Z t -k\>x,\C til Z t ^\>x) = o 

a— °o P(|?7i| > x) 



The convergence (3.241 follows from Lemma |3.4 



Secondly, to establish (3.101, we shall prove that 



\J2k=o C t,k z t-k\ > x) s^vnn „ |o^ 
P( ?7i > a;) z — " 



k=0 



and 



Set 



\J2T=0 C t,kZt-k\ > x) 
P(M>a;) 



< 



k=0 



S m — 2_^ Ct.kZt-k and R m — 2_^ Ct,k%\ 

k — 771+1 



t-k- 



k=0 



Notice that 



and 



(3.27) 



(3.28) 



(3.29) 



J2E(\C l!k at-k\ a ). (3.30) 



V(\S m + R m \>x) > V(\S m \>x(l + £),\R m \<x£) 

> P(S m >x(l + £))-¥(\R m \>x£) (3.31) 

P(|S m + Rm\ >x)< ¥(\S m \ > x(l - e)) + PfliiJ > x£) (3.32) 
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n (3.241, 


PflSm 


>x(l + 


e)) 




lim 

x — >oo 


(1 


P( 


Vi\ > x ) 




ing m — > oc 


and e 


— > it gives 






P 


(|S m |>z(l + 


e)) 



(l + e )-°gE(|(7 llfc a t _*r). 



fc=0 



k^oo P(|r/i| > x) 

Now we have to establish that 



= 5^E(|C 1 , fc cr t _ fc | a ). 



fc=0 



lim n\R m \^e X ) ^ Q 
^^oo P(|»7i| > x) 



(3.33) 



(3.34) 



Hence 



\Rm\ > ex) 



/ J C t ,kZt-i 

k — 771+1 



> CC£ 



< 



< 



E \C't^Z t -k\>xe 

= 777+1 J 

OO \ 

^ c fc \Z t -k\ > xe 



\k=m+l 



\k — 771+1 



< P [ J2 c k \Z t _ k \>xe Y, c k 



\k—m-\-l 



k=m-\-l 



< ]T F(\Z t _ k \>xc- 5 e) 



k—7n-\-l 
00 



< Y p (imi > ^r-W 5 £ ) 



lim 

x — *oo 



\R m \ > ex) 

>(\m\>*) 



< E (vt-k^e)-" 



k — 771+1 



strated. 

Proof of Theorem 3.2 

First, we shall show that 



By H 3 , we obtain (3.34 1. Combining (3.311 (3.331 and (3.34 1, we obtain (3.291 



(3.301 follows from (3.321 (3.331 and (3.34 1. The theorem is entirely demon 



Um ¥(ET=oCt,kZ t .,>x) ^ a where ^ = 

e— >oo F( |t7i| > x) / -^ 



fe=0 



CTkVk- 

(3.35) 
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By Lemma |3.3| we have 



lim 



t,kZt-k > x) 



x— oo P(|77i| > x) 



Tr E[\C tik a t - k \ a } 



(3.36) 



.. F{Ct, k Zt-k>x,C t ,iZ t _ l >x) 

hm ■ —71 — : \ > 

2:^00 IP(|»7i| > x) 

because 

nCt, k Z t -k > x,C t .jZ t ^ >x)< ¥(\C t . k Z t ^ k \ > x, \C u Z t _i\ > x) -> 



By Lemma |3.4| we get ( |3.35 |. 
Notice that 



Rm > x) > ¥(S m > x(l + e), \R m \ < xe) 

> V(S m >x(l + e))-¥(\R m \>xe) (3.37) 



and 



+ R m >x)< V(S m > x(l - e)) + V(\R m \ > xe) 
Combining ( |3.37| ,( |3.38) , ( |3.34| and ( |3.35| we have 



r (J2T=o c t,k z t-k > x) ^ 

p{lml>x) > ^7ToE(|C llfc * t _ fc | )• 



fc=0 



and 



^(J2T=o C t,kZ t -k > x) y^ a 
¥{lml>x) -^ E(\C^a t ^\ ). 



fe=0 



Combining (3.391 and (3.401, (3.111 follows analogously 



(3.38) 



(3.39) 



(3.40) 
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Abstract 

The purpose of this paper is to establish condition for the relative controllability of 

a perturbed infinite neutral differential systems with the perturbation function 

having implicit derivative, and multiple lumped time varying delays in the control. 

Our aim is achieved by defining the appropriate control and its corresponding 

solution by an integral equation. We then obtain the solution by applying the 

Schauder fixed point theorem. Some special cases of the perturbation function are 

also discussed. 
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perturbation. 

1. INTRODUCTION 

In Davies [3], the importance of delays in differential equations were discussed 

and the emphasis was on neutral functional differential equation (one in which the 

derivatives of the past history or derivatives of functional of the past history are 

involved as well as the present states of the system); because of its theoretical and 
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practical interest. For example, neutral functional differential equations are natural 
models for voltage and current fluctuations in problems arising in transmission 
lines, they also appear in the study of population dynamics, vibrating mass 
attached to an elastic bar etc. Remarkable contributors in this area of study include 
Hale and Verduyn Lunel [6], Kuang and Feldstein [16], Park [4], Xu et al [10] etc. 
Several authors Chukwu [2], Fu [15], Gahl [14], Balachandran and Anandhi [12]; 
Mahmudov and Zorlu [13] have investigated the controllability of neutral 
functional differential equation and results obtained through fixed point 
approaches, the choice of fixed point depends on the type of nonlinearity in the 
state equation. The control equation of neutral functional differential equation has 
applications in ecology, epidemics, population growth and in some complex 
economic studies etc . (see Onwuatu [9]) 

For controllability of neutral functional differential equations with implicit 
derivative in the perturbation function, very little attention has been drawn. Here, 
the problem is made more complex with the difficulty of making the right 
conditions to suit the fixed point of interest. However, Gahl [14]; Balachandran 
and Balasubramaniam [11] have illustrated the controllability of such systems. In 
[11], Balachandran and Balasubramaniam studied the controllability of nonlinear 
neutral Volterra integrodifferential systems with implicit derivative through the 
notions of condensing map and measure of noncompactness of a set by the use of 
Sadovskii fixed point theorem. 
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Our objective in this research is to extend the result in Gahl [14] by studying the 
relative controllability of a more general class of infinite neutral functional 
differential systems with the perturbation function having implicit derivative, and 
multiple lumped time varying delays in the control. Our method of approach shall 
be to define the appropriate control and its corresponding solution by an integral 
equation. We then obtain the solution by applying the Schauder fixed point 
theorem. Some special cases of the perturbation function are also discussed. 
2. BASIC NOTATIONS, PRELIMINARIES AND DEFINITIONS 
Suppose h > is a given number, is = (-00,00) , E" is a real n - dimensional 
Euclidean space with norm | • | C = C([-h,0],E n ) is the space of continuous 
function mapping the interval [-h,0] into E n with the norm | • | where 
|^|=surj^ <s < \<Hs)\, for ^eC. Let r e E, a>0 and xeC([r-/z, r + a], is"), then 
given t e [r, r + a], we define the symbol x t by x,(s) = x(t + s), - h < s < . 
Let gbe a bounded linear operator taking [r,co] xC-)£", we define the functional 
difference operator D(-):[t,co]xC — >is" by 

D(t)0=m-g(t,t) (2.1) 

for te[r,cc], ^eC, we now define a neutral functional differential equation to be a 
system of the form 

±-D{t)x=f{t,x t ) (2.2) 

at 
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where x t e C, and / is a continuous function from (r,oo) xC into E" , we say that 
x is a solution of (2.2) with initial value <j> at <j if there exists ae [r,<x>], a > 
such that xeC[[a-h, a + a],E" ), x = (j>, D(t)x t is continuously differentiable on 
{(j,<j + a) and (2.2) is satisfied on (<j,<7 + a) . 
We shall consider perturbed neutral control systems of the form 

I 

— D(t)x t = L(t, x, u) + j" A(G)x(t + 6)d6 

dt _ fX (2.3) 

+ f{t,x{t),x{t),u{w Q {t)),u{w i {t)),...,u{w j {t)),...,u{w N {t))) 
its linear base control system 

—D(t)x=L(t,x,u) (2.4) 

dt 

and its free system 

j 

—D(t) Xl =L(t,x,0)+ \A{6)x{t + 6)d6 (2.5) 

dt J 

— CO 

where D(t)x t =x(t)-Ax(t-\), L(t,x,u)=Gx(t)+Bx(t-\)+Fu(t)+Hu(t-h) . 
A,B,G are nxn matrices, F ,H are nxm matrices. A(0) is an nxn matrix 
whose elements are square integrable on (-oo,0]. If <fieC\[-h,0],E n ), xeE", the 
function f:ExM l xM 2 xM 3 -> E" (where M, is the space of continuous 
n - vector functions on [CVJ, M 2 is the space of continuous n - vector functions 
on [0, t x ] - 5*3 with finite left and right limits on 5* 3 ; and M 3 is the space of 
admissible controls on [\-h, fj). The continuous strictly increasing functions 
Wj(t) :[0,t l ]^' E, j = 0,1,2,...., N , represent deviating arguments in the control, 
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that is, Wj(t) = t-hj(t) ,where hj(t) are lumped time varying delays for 

j = 0,1,2,... .,N. We assume also that the functions Wj(t) : [0,^] -» E , 

j = 0,1,2,... .,N are twice continuously differentiable and strictly increasing in [0,£j . 

Further, Wj (t)<t for t e [0, *, ] , y = 0, 1, 2,.. .., N . We introduce the time lead 

function (see[5]) 

r,(0:K(fo)' w A)J~*[°''i]> 7 = 0,l,2,....,iV, such that r,(w, (*))=* for fe[0,^]. 

Without loss of generality, we assume that h (t) = t and the following inequality 

holds for t = t 



"1 



A = w N {t,)< w N _ x {t,)< .... < w^ft) <t Q = 

LetX(^)be the unique nxn constant matrix function with the following properties 

a) X(t) = , for t < 

b) X(t) = I the identity matrix 

c) X{t) - AX{t - 1) is continuous on [0,oo] 

d) X(t) satisfies X(t) -Ax(t-\) = L(t, x,0) 

for t e(0,oo)- 5*2 , where 5 2 is the set of non-negative integers. 

Then a unique solution of (2.4) exist on [1, t] satisfying x L (t,u)=<p(t) for t e [0,1] 

and by Gahl [14], this solution is given by 

x L (t,u)=X(t -l)0(X)-X(t -2)0(l) + lx(t -s -X)[A0(s) +B0(s)]ds 

(2.6) 
+ jx(t - s)[Fu(s) + Hu(s - h)]ds 
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for all fe[l,*j]. x L (t,u) is a continuous function which satisfies (2.4) on 
J = [l,t 1 ] except for a finite number of points which are contained in the set 

5*3 =S 2 {t:t=t x ±h + I; t*k or h* I, for k e S 2 ] 

Define the matrix functions Z by 

Z(t, s) = X(t - s)F + X(t-s- h)H 

Then it follows immediately that 

x L (t, u) = x L (t, 0) + j Z(t, s)u{s)ds (2.7) 

i 

We note from remarks in [14] that since X(t) is continuous and bounded on 
[0,t,]-S 2 

— Z(t,s) = X(t-s)F + X(t-s-h)H 
dt 

Then, the corresponding solution of (2.3) following the methods of Gahl [14] and 

Sinha [1] is given by 

x(t,<f>,u,f) = x L (t,u) +q(t,s,8) 

+ ^X(t,s)f(s,x(.),x(.),u(w (.)),u(w 1 (.)),...,u(w J (.)),...,u(w N (.)))ds 

i 

or 

i 
x(t, <j),u,f) = x L (t, 0) + q{t, s, 6) + \ Z(t, s)u(s) ds 

(2.8) 

+ ^X(t-s)f(s,x(.),x(.)Mw (.)),u(w l (.)),...,u(Wj(.)),...,u(w N (.)))ds 

i 

for t e J , so that x(t, 0,u,f) satisfies (2.3) on J -S 3 , 
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where 

( 

q(t, s,0)=\X(t-s)\ A($)x(t + 6) d6 ds 

1 -00 

Here the control of interest are all functions u with u(t) = for t <\ which are 
also piecewise continues and bounded on J with all points of discontinuity 
contained in the set 

5", = {l, ^-1,^-2, ,t l -h-\, t x -h-2, }nJ 

and being of simple type yielding finite jumps in u . 
We now give some definitions upon which our study hinges. 
Definition 2.1 

The system (2.3) is said to be relatively controllable on J if, for every function 
fieC, and every x x e E n , there exists an admissible control function u such that 
the solution of the system (2.3) satisfies x{t x ) = x x . 

Definition 2.2 

The controllability matrix of (2.3) will be given by 



W = $Z(t,s)Z T (t,s)ds 



where Z T is the transpose of Z . 

3. CONTROLLABILITY RESULTS 

Here we state theorem which summarize the main results of this section. 
Theorem 3.1. The system (2.4) is relative controllable on J if and only if W is 
nonsingular. 
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Proof: The proof can be observed from Proposition 3.1 of Dauer and Gahl [8] 
MAIN RESULT OF THIS PAPER 

We are now ready to obtain our main result of this paper which extends those of 
Gahl [14] and Davies [3] to the relative controllability of infinite neutral functional 
differential systems with perturbation function having implicit derivative, and 
multiple lumped time varying delays in the control. 

Let Q be the Banach space of all functions (x,u):[0,t l ]x[\-h,t l ]-> E" xE m , 
where x is in M l , x is inM 2 , and u is in M 3 . The norm on Q is 
|(x,«) J] = || X || + 1| w I + \\xj 

where 

I x I = sup| x(t) I for t e [0,t x ] , 

|*| = sup| x(t) | for t e [0,rj - S 3 , 

\\u\\ = sup| u(t) | for t e [1 - h, t x ] . 
That Q is a Banach space follows with the aid of the fact that if {x n (t)} is a 
uniformly convergent sequence on a bounded interval converging to some 
function x(t) and if {x n (t)} is also uniformly convergent, then {x n (t)} converges 

uniformly to x(t) . 
For system (2.3), take 

k = (x,u)eE n xE n xE (N+1)m 
and let 
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|£| = |jc| + |jc| + |k | + |«j| + ... + \Uj \ + ... + \u N \, 



where | • | denotes the standard norm in the finite dimensional Euclidean space 
We now assume the following conditions on / : 
H :sup{\f(t,x(.),x(.),^w (.)),u(w i (.)),...,u(w j (.)),...,u(w N (.)))\:t€ J -S 3 }<G(r)<<x> 

For all (x,u) e Q such that I k I < r , where lim— — = 

r— >co y 

Hi : Let {(x n ,u n )}e.C n [t ,t l \Y.C m [t ,t l \ be a bounded sequence such that 

{(u n (t-h)}, {u n (t)},{x n (t)} and {x n (t-Y}} are each equicontinuous for 
te[a,b]^ J. Then {f(t,x(.),x(.)Mw (.))Mw 1 (-)),-Mw j (.)),...Mw N (.))))is 
equicontinuous on [a, b]. 
Theorem 3.2. Let / be continuous on J -S 3 xM { x M 2 x M 2 with finite left and 
right limits on S 3 and assume / satisfies conditions H and Hi. If system (2.4) is 
relatively controllable on J , then system (2.3) is relatively controllable on J. 
Proof: By Theorem 3.1 W ~' exists. Let <j> be an n -vector function on [0,1] of class 
M, , and x x e E" . We define an operator T on Q by T(x,u) = (y,v) , where 

v(t) = Z T (t,s)W~\t,s) 

t 
x x -x L (t,0)- q(t,s, 0) - ^ X(t - s)f(s,x(-),x(-),u(w (-))Mw l (-)),...u(w j (■)),..., u(w N (-)))ds 

i 

for reJ, and v(t) = for t < 1 ; 
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y(t) = x L (t;0) + q(t, s, 0) + f Z(t l , s)v(s)ds 

i 

+ ^ X(t - s)f(s,x(-),x(-),u(w (-)),u(w 1 (-)),...u(w J (-)),...,u(w N (-)))ds 

i 

for te J, and y(t)=<fi(t) for 0<t <\ . 

We show that T.Q-+Q .By the definition of Z(t,s) and the remarks following in 

section 2, v(t)is an admissible control function. Since x L (l,0)=^(l), y(t) is 

continuous on [0,^]. In order to show that (y,v)eQ, it remains to establish 

that y(t) eM 2 . Let t e J -S 3 . To obtain an expression for y(t) we use the fact that 

Z(t,s) is discontinuous on J for 

s= t,t-l,..., t-h, t-h-\,..., and X(t-s)is discontinuous for s =t, ?-l,....Then 



t p(t) '-"/ + i t-a, 

I Z{t,s)v{s)ds =2^ I Z{t,s)v{s)ds + I Z{t,s)v{s)ds 

1 j=\t-aj 1 

where t-a j ,j = \, ,P(t)+\, are the points of discontinuity in s of Z(t,s) for 

s e [1, t] . Using - and + to denote left and right limits respectively, 

d c p 3Z 

Z(t,s)v(s)ds = — (t,s)v(s)ds 
• • dt 



dt j , 

+ Y,[Z(t,(t-a J+i y).v(t-a j+l )-Z(t,(t-a j y).v(t-a j )\ 

7=1 

+ Z(7,(/-a i r).vO-a 1 ) 
We are also using here the fact that the points t - a . are points of continuity of 
v, since, if r -a y sS l then * €6*3 . By the definition of Z(t,s) 
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d r (• pit) 

— ]Z(t, s)v(s)ds = J (X(t - s)F + X(t-s- h)H)v(s)ds + J] ^ (0 

af i i .7=0 

where 

R Xt)=[x(a+ +l )F + X((a j+l -h) + )H]v(t-a j+x )- [x(a])F + X((a . -A)-)#]v(f-a,) 

a =0, and recall that X(0 ) = 0.We note that a similar derivation is needed to 
show that the expression for x L (t;u) in equation (2.6) satisfies (2.4) on J except for 
points where t - a } e Sj or t e S 2 . Thus, the defined structure of S 3 is necessary. 
Similarly, for t eJ-S 3 , 

^X(t-s)f(s,x(-),x(-),u(w (-)),u(w 1 (-)),...u(w j (-)),...,u(w N (-)))ds 



dt j 



= \x(t- s)f(s, x(-), x(-), u(w (•)), u(w 1 (-)),...u(Wj (■)),..., u(w N (-)))ds 



i 

;=1 



A'((i-l) + )/(f-i + l,jf(.),i(0,«(w o (0),«(w 1 ('))v.-»(w i (0)v.. > "(w Ar (0)) 

- X(F)f(t - 1, *(•), *(•), «(w (•)), «(W! (•)),- . J/(w y (•)),-, "(Wjy (•))) 
+ X(([t] - \) + )f(t - [t] + 1, *(•), *(•), «K (•)), u( Wl (-)),...u(Wj (■)),..., u(w N (•))) 

where [t] is the largest integer <t and if [t] = lthe sum is empty. We are also using 

here the fact that if t e J-S 3 then t-ieJ-S 3 for z'=l,2,...,[7]-l, along with the 

continuity assumption on / . Rearranging terms we have 



— ^ X(t - s)f(s,x(-),x(-),u(w (-)),u(w 1 (-)),...u(w J (-)),...,u(w N (-)))ds 

= J^-j)/(*,j:(0,i(0 > «(Wo(')) > "(w 1 (0)v.-«K0))v» > «(w >r 0)))ds + S / '(O 

1 i=0 

where 
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p / (O = [A'(i + )-A'(r)l/-(f-i\j C (0,i(0,«(wo(0) > "(w 1 (0)v.«K(0)v..,«(w v (-))) 

Then for teJ -S 3 we have 

* p(') 

y(t) = x L (t;O) + q(t,s,0)+\(X(t-s)F + X(t-s-h)H)v(s)ds + Y, R j(t) 

1 7 = 

+ \x{t-s)f{s, x(-),x(-),u(w (•)),u(w l (•)),... «(w y (•)),..., u(w* (•)))<& ( 3J ) 

1 
m-i 

i=0 

Since jf(0 is continuous on J -S 3 and has finite left and right limits on 

I 

S 3 j(0 e M 2 and r : -> g . Where ?(/, i, 6>) = J X(t, s) J ,4(0)jc(f + 0) d6 ds 

1 -00 

Let us introduce the following notations 

a x - sup |Z(7,s)| for \<s<t<t x 

a 2 =| JF _1 0,s)| 

a 3 = sup ( | x L (t;0) | + 1 q(t, s, 6) | + |xj | ) for ^ e J 

a 4 = sup |X(Y)| for 0< t< t x 

a 5 = sup \X(t)\ for ?e[0, ^]-5 2 

a 6 = sup ( |x z (t;0)\ + 1 #(/, i, 0)\ ) for r e J - S 2 

a 7 = \F\ + \H\ 

b = max {(t l -1) a l ,\,(t l -1) a 5 a 7 +2 (/?(/[) +1) a A a 7 } 

c, = (27V + 6)6a ja 2 a 4 (?j - 1) 

c 2 =(2JV + 6)a 4 (^-l) 
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c 3 =(2N + 6)[2[t l ]a 4 +(t l -l)a 5 ] 

d x = (2N + 6)a x a 2 a^b 

d 2 = (2N + 6)a i 

d 3 =(2N + 6)a 6 

c = max{cj,c 2 ,c 3 } 

d = maxjflfj, d 2 , d 3 \ 

sup|/| =swp\f(s,x(-),x(-),u(w (-)),u(w l (-)),...u(w j (-)),...,u(w N (-)))\ for Se J-S 3 

Lim G(r) 
Since ^is of class MjOn [0,1] and — — = 0, by Proposition 3.1 in Dauer [7], 

r — > oo r 

f satisfies the following condition: for each pair of positive constants cand d , 

there exists a positive constant r such that if I k \<r , then 

cG{r)+d<r (3.2) 

Also, for given c and d , if r is a constant such that (3.2) is satisfied, then any r x 

such that r < r x will also satisfy (3.2). Now take c and d as given above, and let r 

be chosen so that (3.2) is satisfied and sup \(/)(t)\ for t e [0, 1]< r (N + 3) _1 , sup <j> for 

*€[0,l]<r(iV + 3)- ] . 

Therefore, if 

J x J < r(N + 3Y 1 , || w || < r(N + 3)~ ' , and \\x\\< r(N + 3)" 1 

Then 

N 

\k\ = \ x(s) | + ^ u(Wj (s)) \<r for all s e J . 

7=0 
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It follows from property H that if I k \<r, then csup|/|+ d<r . Now let 

Q(r) = {(x,u)eQ:\\(x,u)\\<r}, 
and let (x , u) e Q (r) . Then 

|v(0| ^ a l a 2 [a 3 + (t t - \)a 4 sup|/| ] < d y [(2N + 6)b\ x + c l sup|/|[(2iV + 6)b]~ l 
< (d + csup\f\\(2N + 6)b]~ l <r[(2N + 6)b]~ l < r (2N + 6) _1 for all t e J 

Similarly, 

\y(t)\< a 3 +(t l — l)a 1 ||v|| + (? 1 -l)a 4 sup|/| < d 2 (N + 3y 1 +b\\v\\ + c 2 sup\f\(2N + 6)~ l 

< r(2N + 6y l + (d + c sap\f\\2N + 6) 1 < r(N + 3) _1 

for all t e J 

Using equation (3.1) and the expressions for i? y (/)and P t (t) and letting t <eJ-S 3 , 

\y(t)\< a 6 + (t l -l)a 5 a 7 |v| + 2(P(/ 1 ) + l)a 4 a 7 ||v|| + ((7 1 -l)a 5 +2[t x ]a 4 )sup|/| 

< d 3 (2N + 6)" 1 + b\\v\\ + [c 3 up\f\\2N + 6) _1 

< r(2N + 6) _I + [d + c sup|/| \lN + 6) _1 
<r(A^ + 3)"' 

Hence \\(y,v)\\ < r, and T : Q(r) -* Q(r) 

By the continuity assumption on /, T is continuous on Q. Now let P(r) be closed 

convex hull of T(Q(r)), and we show that T has a fixed point in P(r) . Since Q{r) is 

closed, bounded and convex in Q and T:Q(r) -^ Q{r);P{r) is also closed, 

bounded, and convex in Q{r) and 7 1 : P(r) -> P(r) . In order to apply the schauder 

fixed point theorem it remains to show that T is completely continuous on P(r) . 
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Let {(}>„, v„)}* =1 be a sequence in T(P(r)), and we show that it has a convergent 
subsequence in Q. Let 0„,v„) = T(x n ,u n )for some (x n ,u n )eP(r). Since 
|0„,vj|<rfor all «, the sequence {y„(0}, {y„(0}> and { v „(0}are each uniformly 
bounded on the sets [0,^], [O,^]-^, and [l-h, t { ] respectively. Further, by the 
boundedness assumption on /and since P(r) is contained in g(r);the sequence 
{y„(/)}is equicontinuous on [0,tj. Also since Z T (t l ,s) has a continuous extension 
on the closure of each subinterval of [l-h, tJ-S^, the sequence {y n (t)} can be 

extended to be equicontinuous on the closure of each of these subintervals. We 
note that the equicontinuity holds for all member of T(Q(r)) . Hence it holds for 
the limit points in Qof all convex combinations of members of T(Q(r)) and, 
therefore, it holds for all members of P(r) . Thus {jt„(*)}is equicontinuous on [0,^] 
and {u n (t)} can be extended to be equicontinuous on the closure of each subinterval 
of [l-h, t^-S,. 

We now apply property Hi in order to show that {y n (t)} can be extended to be 
equicontinuous on the closure of each subinterval of [0,^ ]-S 3 . For t e J - S 3 , it 
follows that t-ie[0,t l ]-S 3 and t - h - i e[l- h,^]- S 1} for i =0,1, 2,. ..,[*]. 
Therefore, each of the sequences {u n (t - /)}, {u n (t-h- /)}, {x n (t - i)}, and 
{x n (t-i-\)},foT i=0,\,2,...,[t]-\ can be extended to be equicontinuous on the 
closure of each subinterval of J -S 3 . By property Hi the sequence 
{f(t-UxA-),xMu ll (w (-)lu n (w l (-)l---u ll (w j (-)),...,u n (w N (-)))\ is equicontinuous on 
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the closure of each of these subintervals for i=0,\,2,...,[t]-\. It follows from 
equation (3.1) that the sequence {y n (ty] can be extended to be equicontinuous on 
the closure of each subinterval of [0, t x ] - S 3 . Now by successive applications of 
Ascoli's theorem we obtain a convergent subsequence of Q of {(y„,v n )}. Hence, 
T(P(r)) is sequentially compact and, therefore, its closure is also sequentially 
compact. This implies that T is completely continuous on P(r) . 
By the Schauder fixed point theorem T has a fixed point in P(r) , call it (x,u) . 
Therefore 

x(t) = x L (7,0) + q(t, s,0) + \ Z(t, s)u(s)ds 

i 

+ ^ X(t - s)f(s,x(-),x(-),u(w (-)),u(w l (-)),...u(w J (-)),...,u(w N (-)))ds 

i 

for t e J, and x(t) = <fi(t)for t s [0,1] . 
Also 

x(t 1 ) = x L (t 1 ;O) + q(t,s,0)+\z(t 1 ,s)Z T (t l ,s)x 

i 

r x x -x L (t x ;Q>)-q(t,s,6) 

t 
- ^ X(t - s)f(s,x(-),x(-),u(w (-)),u(w l (-)),...u(w j (-)),...,u(w N (-)))ds 

+ ^X(t-s)f(s,x(-),x(-),u(w (-)),u(w l (-)),...u(w j (-)),...,u(w N (-)))ds = x l 

i 

This completes the proof, since x(t) is the desired solution. 



W-\t,s,u) 



ds 
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4. EXAMPLES 

In the sequel, we shall consider some examples of the function / which satisfies 
the hypothesis of Theorem 3.2 
Example 4.1 
Let 

f = k(t,x(t),x(t -l),u(w (t)),u(w 1 (t)),...,u(w j (t)),...,u(w N (t))) + 

j" g(s,x(s),x(s -v(s)),x(s),x(s -0(s)),u(w o (s)),u(w 1 (s)),...,u(Wj(s)),...,u(w N (s)))ds 
1 

where Wj(t) is as defined in Section 2 , v and 6 are nonnegative measurable 
functions; and the n -vector functions k and g are defined on the appropriate E" 

spaces as in H . It should be noted that term of the form [g(x(s))ds are of the so 

i 

called renewal type and are included in systems treated by Dauer and Gahl [8]. 
Example 4.2 

Take g = in Example 1. Then note that / is independent of x(.) and has an E" 
space domain, which is a characteristic of perturbation functions used in other 
treatments of controllability. But, if / depends on i(.) then in order to satisfy 
condition H 1? we must include function spaces in the domain of /, which is a 
characteristic of the perturbation functions treated in Gahl [14]. 
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CONCLUSION 

We have studied the relative controllability of perturbed infinite neutral 
differential system with perturbation function having implicit derivative, and 
multiple lumped time varying delays in the control using the Schauder fixed point 
theorem. It was shown that, if the linear control system is relatively controllable, 
then the nonlinear system is relatively controllable provided that the perturbation 
function whose domain contains appropriate function spaces satisfies certain 
growth and continuity conditions. 
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